2026-03-25 21:45:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 21:45:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 21:45:05 [ayvens.de] INFO: Starting spider ayvens.de
2026-03-25 21:45:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 21:45:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 21:45:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 21:45:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 21:45:05 [scrapy.extensions.telnet] INFO: Telnet Password: dcc68f324a576945
2026-03-25 21:45:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-25 21:45:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.de/task_43_2026-03-25T21_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-25 21:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 21:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 21:45:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 21:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-25 21:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 21:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 21:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-25 21:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-25 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-25 21:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-25 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-25 21:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-25 21:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-25 21:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-25 21:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 21:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 21:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-25 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-25 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-25 21:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-25 21:45:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-25 21:45:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-25 21:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-25 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-25 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 21:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-25 21:45:19 [ayvens.de] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'y0+MMmxXZPI8cz5VYXK11U|2026-03-25T21:45:17.947Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806011117, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': '0nkt1SOEhftTp3FRYqFRxV|1774475119267|1774475119267', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774476919, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-25 21:45:19 [ayvens.de] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'y0+MMmxXZPI8cz5VYXK11U|2026-03-25T21:45:17.947Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': '0nkt1SOEhftTp3FRYqFRxV|1774475119267|1774475119267', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-25 21:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-25 21:45:19 [ayvens.de] INFO: Intercepting token...
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-25 21:45:19 [ayvens.de] INFO: Scrolling element to trigger lazy load...
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-25 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 21:45:19 [ayvens.de] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-25 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-25 21:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-25 21:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-25 21:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 21:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-25 21:45:21 [ayvens.de] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-25 21:45:21 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-25 21:45:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 21:45:24 [ayvens.de] INFO: Found listing with ID: 1982510
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982510%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [ayvens.de] INFO: Scrape type for 1982510: 1
2026-03-25 21:45:24 [ayvens.de] INFO: Extracting data for car ID: 1982510
2026-03-25 21:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee6e97df-8ec8-5f11-a102-13d1273de30a with identifier: 1982510
2026-03-25 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6e97df-8ec8-5f11-a102-13d1273de30a with scrape type 1
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/1.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/2.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/3.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/4.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/5.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/6.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/7.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/8.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/9.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/10.jpg not downloaded yet
2026-03-25 21:45:24 [ayvens.de] INFO: Found listing with ID: 1982511
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982511%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [ayvens.de] INFO: Scrape type for 1982511: 1
2026-03-25 21:45:24 [ayvens.de] INFO: Extracting data for car ID: 1982511
2026-03-25 21:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1982511
2026-03-25 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with scrape type 1
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/1.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/2.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/3.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/4.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/5.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/6.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/7.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/8.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/9.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/10.jpg not downloaded yet
2026-03-25 21:45:24 [ayvens.de] INFO: Found listing with ID: 1982512
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982512%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [ayvens.de] INFO: Scrape type for 1982512: 1
2026-03-25 21:45:24 [ayvens.de] INFO: Extracting data for car ID: 1982512
2026-03-25 21:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1982512
2026-03-25 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/1.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/2.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/3.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/4.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/5.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/6.jpg not downloaded yet
2026-03-25 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/7.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/8.jpg not downloaded yet
2026-03-25 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/9.jpg not downloaded yet
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/10.jpg not downloaded yet
2026-03-25 21:45:24 [ayvens.de] INFO: Found listing with ID: 1982513
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982513%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [ayvens.de] INFO: Scrape type for 1982513: 1
2026-03-25 21:45:24 [ayvens.de] INFO: Extracting data for car ID: 1982513
2026-03-25 21:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1982513
2026-03-25 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/1.jpg not downloaded yet
2026-03-25 21:45:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 21:45:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130627e50>
2026-03-25 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/3.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2a2d0>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/2.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a52090>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/1.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/2.jpg not downloaded yet
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306089d0>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/7.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/3.jpg not downloaded yet
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/4.jpg not downloaded yet
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/5.jpg not downloaded yet
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a62f90>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/8.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/6.jpg not downloaded yet
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/7.jpg not downloaded yet
2026-03-25 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130659cd0>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/10.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b62750>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/4.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ab89d0>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/5.jpg saved to cache
2026-03-25 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b60690>
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/6.jpg saved to cache
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/8.jpg not downloaded yet
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/9.jpg not downloaded yet
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/10.jpg not downloaded yet
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132502690>
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/2.jpg saved to cache
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130617dd0>
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Ff54e87f14bfc4eaeb5d6fcfd4b5b4fe5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/9.jpg saved to cache
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee6e97df-8ec8-5f11-a102-13d1273de30a
2026-03-25 21:45:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee6e97df-8ec8-5f11-a102-13d1273de30a, skipping ID generation
2026-03-25 21:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6e97df-8ec8-5f11-a102-13d1273de30a with scrape type 1
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee6e97df-8ec8-5f11-a102-13d1273de30a sending to next pipeline
2026-03-25 21:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ee6e97df-8ec8-5f11-a102-13d1273de30a, identifier: 1982510
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130626c50>
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/1.jpg saved to cache
2026-03-25 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ee6e97df-8ec8-5f11-a102-13d1273de30a with identifier: 1982510
2026-03-25 21:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ee6e97df-8ec8-5f11-a102-13d1273de30a with identifier: 1982510
2026-03-25 21:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ee6e97df-8ec8-5f11-a102-13d1273de30a with identifier: 1982510 to the API
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'ee6e97df-8ec8-5f11-a102-13d1273de30a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 65268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6e97df-8ec8-5f11-a102-13d1273de30a/ee6e97df-8ec8-5f11-a102-13d1273de30a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/f54e87f14bfc4eaeb5d6fcfd4b5b4fe5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982510%27 HTTP/1.1" 200 None
2026-03-25 21:45:26 [ayvens.de] INFO: Saving data for 1982510: {'created_time': 1774475126.955427, 'last_price_update_time': 1774475126.95544, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982510') HTTP/1.1" 204 0
2026-03-25 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:26 [ayvens.de] INFO: Found listing with ID: 1982514
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982514%27 HTTP/1.1" 200 None
2026-03-25 21:45:26 [ayvens.de] INFO: Scrape type for 1982514: 1
2026-03-25 21:45:26 [ayvens.de] INFO: Extracting data for car ID: 1982514
2026-03-25 21:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1982514
2026-03-25 21:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66796465-7353-572a-9087-319a58d72a35 with scrape type 1
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/1.jpg not downloaded yet
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/2.jpg not downloaded yet
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/3.jpg not downloaded yet
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/4.jpg not downloaded yet
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6ca390>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/4.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/5.jpg not downloaded yet
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/6.jpg not downloaded yet
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/7.jpg not downloaded yet
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130661910>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/3.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306e8910>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/4.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306d9650>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/6.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cf490>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/3.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306d8450>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/5.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/8.jpg not downloaded yet
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/9.jpg not downloaded yet
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130395590>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/5.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130671390>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/7.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/10.jpg not downloaded yet
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [ayvens.de] INFO: Found listing with ID: 1982515
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982515%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [ayvens.de] INFO: Scrape type for 1982515: 1
2026-03-25 21:45:27 [ayvens.de] INFO: Extracting data for car ID: 1982515
2026-03-25 21:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1982515
2026-03-25 21:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with scrape type 1
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/1.jpg not downloaded yet
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/2.jpg not downloaded yet
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/3.jpg not downloaded yet
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/4.jpg not downloaded yet
2026-03-25 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6b2590>
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/1.jpg saved to cache
2026-03-25 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/5.jpg not downloaded yet
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130705810>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/2.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/6.jpg not downloaded yet
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/7.jpg not downloaded yet
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ae390>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/3.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f70d0>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/4.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130673650>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/5.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f4510>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/10.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6912d0>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/9.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f5910>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/8.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/8.jpg not downloaded yet
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/9.jpg not downloaded yet
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/30dbf286619944d696f046d8d2955766/images/large/10.jpg not downloaded yet
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [ayvens.de] INFO: Found listing with ID: 1982516
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982516%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [ayvens.de] INFO: Scrape type for 1982516: 1
2026-03-25 21:45:28 [ayvens.de] INFO: Extracting data for car ID: 1982516
2026-03-25 21:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1982516
2026-03-25 21:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/1.jpg not downloaded yet
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/2.jpg not downloaded yet
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130351bd0>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/10.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303513d0>
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/9.jpg saved to cache
2026-03-25 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/3.jpg not downloaded yet
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/4.jpg not downloaded yet
2026-03-25 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/5.jpg not downloaded yet
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064b950>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/2.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306e8b10>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/7.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130603190>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/5.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130396bd0>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/1.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130603550>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/7.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130602210>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/3.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/6.jpg not downloaded yet
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/7.jpg not downloaded yet
2026-03-25 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a519050>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/9.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/8.jpg not downloaded yet
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/9.jpg not downloaded yet
2026-03-25 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/10.jpg not downloaded yet
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6cb1d0>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/8.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:29 [ayvens.de] INFO: Found listing with ID: 1982517
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982517%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [ayvens.de] INFO: Scrape type for 1982517: 1
2026-03-25 21:45:29 [ayvens.de] INFO: Extracting data for car ID: 1982517
2026-03-25 21:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1982517
2026-03-25 21:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a6003-66df-5951-9d5c-6ccb97fe6914 with scrape type 1
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/1.jpg not downloaded yet
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813035bd50>
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/1.jpg saved to cache
2026-03-25 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/2.jpg not downloaded yet
2026-03-25 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ab8110>
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/10.jpg saved to cache
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130384210>
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/2.jpg saved to cache
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130358dd0>
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/4.jpg saved to cache
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/3.jpg not downloaded yet
2026-03-25 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/4.jpg not downloaded yet
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a16190>
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/5.jpg saved to cache
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/5.jpg not downloaded yet
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/6.jpg not downloaded yet
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ac410>
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/7.jpg saved to cache
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132b1a4d0>
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Fb8c2217c950b4090a4bcb44ec62f9f81%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/6.jpg saved to cache
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-25 21:45:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66796465-7353-572a-9087-319a58d72a35, skipping ID generation
2026-03-25 21:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66796465-7353-572a-9087-319a58d72a35 with scrape type 1
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66796465-7353-572a-9087-319a58d72a35 sending to next pipeline
2026-03-25 21:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 66796465-7353-572a-9087-319a58d72a35, identifier: 1982514
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/7.jpg not downloaded yet
2026-03-25 21:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1982514
2026-03-25 21:45:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1982514
2026-03-25 21:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1982514 to the API
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'color': 'Fuji White uni',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '66796465-7353-572a-9087-319a58d72a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover Velar',
 'odometer': 86665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/b8c2217c950b4090a4bcb44ec62f9f81/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover Velar LAND ROVER Range Rover Velar P400e '
          'R-Dynamic Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover Velar P400e R-Dynamic Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982514%27 HTTP/1.1" 200 None
2026-03-25 21:45:31 [ayvens.de] INFO: Saving data for 1982514: {'created_time': 1774475131.765162, 'last_price_update_time': 1774475131.765176, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982514') HTTP/1.1" 204 0
2026-03-25 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/8.jpg not downloaded yet
2026-03-25 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/9.jpg not downloaded yet
2026-03-25 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6cbad0>
2026-03-25 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/9.jpg saved to cache
2026-03-25 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/10.jpg not downloaded yet
2026-03-25 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:31 [ayvens.de] INFO: Found listing with ID: 1982518
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982518%27 HTTP/1.1" 200 None
2026-03-25 21:45:31 [ayvens.de] INFO: Scrape type for 1982518: 1
2026-03-25 21:45:31 [ayvens.de] INFO: Extracting data for car ID: 1982518
2026-03-25 21:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1982518
2026-03-25 21:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72becd66-d34a-5c15-8560-322b276164ff with scrape type 1
2026-03-25 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/1.jpg not downloaded yet
2026-03-25 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093ea90>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/6.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087f450>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/10.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305e9d90>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/8.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a36310>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/4.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/2.jpg not downloaded yet
2026-03-25 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/3.jpg not downloaded yet
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/4.jpg not downloaded yet
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b4890>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/2.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305e9310>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/3.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/5.jpg not downloaded yet
2026-03-25 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/6.jpg not downloaded yet
2026-03-25 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305ff290>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/4.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306eaa90>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/6.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/7.jpg not downloaded yet
2026-03-25 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/8.jpg not downloaded yet
2026-03-25 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/9.jpg not downloaded yet
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6559d0>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/9.jpg saved to cache
2026-03-25 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130387750>
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/7.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/10.jpg not downloaded yet
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [ayvens.de] INFO: Found listing with ID: 1982519
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982519%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [ayvens.de] INFO: Scrape type for 1982519: 1
2026-03-25 21:45:33 [ayvens.de] INFO: Extracting data for car ID: 1982519
2026-03-25 21:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1982519
2026-03-25 21:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5649e09f-005e-5163-abe0-84bf79057a0c with scrape type 1
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/1.jpg not downloaded yet
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8140a7e190>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/8.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2c510>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/10.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036e410>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/1.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/2.jpg not downloaded yet
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/3.jpg not downloaded yet
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/4.jpg not downloaded yet
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130696390>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/2.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ac050>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/4.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/5.jpg not downloaded yet
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/6.jpg not downloaded yet
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a35350>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/3.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/7.jpg not downloaded yet
2026-03-25 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/8.jpg not downloaded yet
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/9.jpg not downloaded yet
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6ca6d0>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/8.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305fdad0>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/5.jpg saved to cache
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/10.jpg not downloaded yet
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305e8390>
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/6.jpg saved to cache
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b63e90>
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/7.jpg saved to cache
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:34 [ayvens.de] INFO: Found listing with ID: 1982520
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982520%27 HTTP/1.1" 200 None
2026-03-25 21:45:34 [ayvens.de] INFO: Scrape type for 1982520: 1
2026-03-25 21:45:34 [ayvens.de] INFO: Extracting data for car ID: 1982520
2026-03-25 21:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1982520
2026-03-25 21:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0501d641-c273-501b-a0b3-9e40312e0901 with scrape type 1
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/1.jpg not downloaded yet
2026-03-25 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130602290>
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/9.jpg saved to cache
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/2.jpg not downloaded yet
2026-03-25 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/3.jpg not downloaded yet
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2f190>
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/2.jpg saved to cache
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130377bd0>
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6427687603d6450baee697f289011d6b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/10.jpg saved to cache
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-25 21:45:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59a6003-66df-5951-9d5c-6ccb97fe6914, skipping ID generation
2026-03-25 21:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a6003-66df-5951-9d5c-6ccb97fe6914 with scrape type 1
2026-03-25 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59a6003-66df-5951-9d5c-6ccb97fe6914 sending to next pipeline
2026-03-25 21:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f59a6003-66df-5951-9d5c-6ccb97fe6914, identifier: 1982517
2026-03-25 21:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1982517
2026-03-25 21:45:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1982517
2026-03-25 21:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1982517 to the API
2026-03-25 21:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f59a6003-66df-5951-9d5c-6ccb97fe6914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 28359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6427687603d6450baee697f289011d6b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982517%27 HTTP/1.1" 200 None
2026-03-25 21:45:35 [ayvens.de] INFO: Saving data for 1982517: {'created_time': 1774475135.172444, 'last_price_update_time': 1774475135.172457, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982517') HTTP/1.1" 204 0
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/4.jpg not downloaded yet
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/5.jpg not downloaded yet
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81321ef790>
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/5.jpg saved to cache
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/6.jpg not downloaded yet
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/7.jpg not downloaded yet
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067dd90>
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/1.jpg saved to cache
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303c0e90>
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/4.jpg saved to cache
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130999110>
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/8.jpg saved to cache
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/8.jpg not downloaded yet
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/9.jpg not downloaded yet
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309ae090>
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/6.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81324f3d90>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/7.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/10.jpg not downloaded yet
2026-03-25 21:45:36 [ayvens.de] INFO: Found listing with ID: 1982521
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982521%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [ayvens.de] INFO: Scrape type for 1982521: 1
2026-03-25 21:45:36 [ayvens.de] INFO: Extracting data for car ID: 1982521
2026-03-25 21:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1982521
2026-03-25 21:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with scrape type 1
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/1.jpg not downloaded yet
2026-03-25 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/2.jpg not downloaded yet
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130abaad0>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/10.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130616490>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/9.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036dbd0>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/1.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/3.jpg not downloaded yet
2026-03-25 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/4.jpg not downloaded yet
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130687bd0>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/4.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/5.jpg not downloaded yet
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/6.jpg not downloaded yet
2026-03-25 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/7.jpg not downloaded yet
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67fbd0>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/5.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b664d50>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/2.jpg saved to cache
2026-03-25 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130349cd0>
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/3.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308acc10>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/6.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/8.jpg not downloaded yet
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/9.jpg not downloaded yet
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130349810>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/10.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/10.jpg not downloaded yet
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [ayvens.de] INFO: Found listing with ID: 1982522
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982522%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [ayvens.de] INFO: Scrape type for 1982522: 1
2026-03-25 21:45:37 [ayvens.de] INFO: Extracting data for car ID: 1982522
2026-03-25 21:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1982522
2026-03-25 21:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c058b7-1536-5792-97e2-c298dcdfc9fc with scrape type 1
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/1.jpg not downloaded yet
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/2.jpg not downloaded yet
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a37050>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/9.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b657410>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/2.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/3.jpg not downloaded yet
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/4.jpg not downloaded yet
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6cb890>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/1.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130396a90>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/5.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130376750>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/8.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813221b950>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/4.jpg saved to cache
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/5.jpg not downloaded yet
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/6.jpg not downloaded yet
2026-03-25 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/7.jpg not downloaded yet
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a28250>
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/3.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/8.jpg not downloaded yet
2026-03-25 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/9.jpg not downloaded yet
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6d4c50>
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/8.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087e5d0>
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/7.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/10.jpg not downloaded yet
2026-03-25 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:38 [ayvens.de] INFO: Found listing with ID: 1982523
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982523%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [ayvens.de] INFO: Scrape type for 1982523: 1
2026-03-25 21:45:38 [ayvens.de] INFO: Extracting data for car ID: 1982523
2026-03-25 21:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1982523
2026-03-25 21:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424e80e5-2158-5404-9f08-eae2ff66ecea with scrape type 1
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/1.jpg not downloaded yet
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/2.jpg not downloaded yet
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130661d90>
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/6.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303ad3d0>
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/1.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/3.jpg not downloaded yet
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/4.jpg not downloaded yet
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b63ec10>
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/2.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130614810>
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/9.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b666290>
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F403b4c4863ca4b329e6229327dea9aad%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/10.jpg saved to cache
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-25 21:45:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0501d641-c273-501b-a0b3-9e40312e0901, skipping ID generation
2026-03-25 21:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0501d641-c273-501b-a0b3-9e40312e0901 with scrape type 1
2026-03-25 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0501d641-c273-501b-a0b3-9e40312e0901 sending to next pipeline
2026-03-25 21:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0501d641-c273-501b-a0b3-9e40312e0901, identifier: 1982520
2026-03-25 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/5.jpg not downloaded yet
2026-03-25 21:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1982520
2026-03-25 21:45:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1982520
2026-03-25 21:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1982520 to the API
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0501d641-c273-501b-a0b3-9e40312e0901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 62799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/403b4c4863ca4b329e6229327dea9aad/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Inspiration '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Inspiration Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982520%27 HTTP/1.1" 200 None
2026-03-25 21:45:39 [ayvens.de] INFO: Saving data for 1982520: {'created_time': 1774475139.413889, 'last_price_update_time': 1774475139.413899, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982520') HTTP/1.1" 204 0
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/6.jpg not downloaded yet
2026-03-25 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/7.jpg not downloaded yet
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67ef90>
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fc279ccde50eb48a9a497996513e756ee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/7.jpg saved to cache
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-25 21:45:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5649e09f-005e-5163-abe0-84bf79057a0c, skipping ID generation
2026-03-25 21:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5649e09f-005e-5163-abe0-84bf79057a0c with scrape type 1
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5649e09f-005e-5163-abe0-84bf79057a0c sending to next pipeline
2026-03-25 21:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 5649e09f-005e-5163-abe0-84bf79057a0c, identifier: 1982519
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67c6d0>
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/6.jpg saved to cache
2026-03-25 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1982519
2026-03-25 21:45:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1982519
2026-03-25 21:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1982519 to the API
2026-03-25 21:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': '5649e09f-005e-5163-abe0-84bf79057a0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'XE',
 'odometer': 83743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/c279ccde50eb48a9a497996513e756ee/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR XE JAGUAR XE P250 Aut. R-Dynamic S Limousine, 4-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'JAGUAR XE P250 Aut. R-Dynamic S Limousine, 4-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982519%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [ayvens.de] INFO: Saving data for 1982519: {'created_time': 1774475140.133209, 'last_price_update_time': 1774475140.133223, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982519') HTTP/1.1" 204 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/8.jpg not downloaded yet
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/9.jpg not downloaded yet
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130999650>
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/10.jpg saved to cache
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130975350>
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/7.jpg saved to cache
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69c5d0>
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/5.jpg saved to cache
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/10.jpg not downloaded yet
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [ayvens.de] INFO: Found listing with ID: 1982524
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982524%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [ayvens.de] INFO: Scrape type for 1982524: 1
2026-03-25 21:45:40 [ayvens.de] INFO: Extracting data for car ID: 1982524
2026-03-25 21:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1982524
2026-03-25 21:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/1.jpg not downloaded yet
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813fec3890>
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/9.jpg saved to cache
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a514810>
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/8.jpg saved to cache
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2f350>
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/1.jpg saved to cache
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/2.jpg not downloaded yet
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/3.jpg not downloaded yet
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308af310>
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/2.jpg saved to cache
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/4.jpg not downloaded yet
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/5.jpg not downloaded yet
2026-03-25 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/6.jpg not downloaded yet
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306548d0>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/4.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303aca10>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/6.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a15310>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/7.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/7.jpg not downloaded yet
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/8.jpg not downloaded yet
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813061d250>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/9.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/9.jpg not downloaded yet
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/10.jpg not downloaded yet
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [ayvens.de] INFO: Found listing with ID: 1982525
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982525%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [ayvens.de] INFO: Scrape type for 1982525: 1
2026-03-25 21:45:41 [ayvens.de] INFO: Extracting data for car ID: 1982525
2026-03-25 21:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1982525
2026-03-25 21:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26e2664-7e50-51e0-9964-f34a1a67d48b with scrape type 1
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/1.jpg not downloaded yet
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2f650>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/10.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813221bf10>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/8.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b60d90>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/5.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/2.jpg not downloaded yet
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/3.jpg not downloaded yet
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309cab90>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/2.jpg saved to cache
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/4.jpg not downloaded yet
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/5.jpg not downloaded yet
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/6.jpg not downloaded yet
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064bf90>
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/6.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b5d90>
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/4.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81325da3d0>
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/5.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/7.jpg not downloaded yet
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/8.jpg not downloaded yet
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130387d10>
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/7.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6c8150>
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/9.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/9.jpg not downloaded yet
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/10.jpg not downloaded yet
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [ayvens.de] INFO: Found listing with ID: 1982526
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982526%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [ayvens.de] INFO: Scrape type for 1982526: 1
2026-03-25 21:45:42 [ayvens.de] INFO: Extracting data for car ID: 1982526
2026-03-25 21:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1982526
2026-03-25 21:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with scrape type 1
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/1.jpg not downloaded yet
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130396010>
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/8.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303ac150>
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/3.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/2.jpg not downloaded yet
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/3.jpg not downloaded yet
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a502c90>
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/2.jpg saved to cache
2026-03-25 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/4.jpg not downloaded yet
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/5.jpg not downloaded yet
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/6.jpg not downloaded yet
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036e1d0>
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/1.jpg saved to cache
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a15e10>
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/1.jpg saved to cache
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6ac350>
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F6d2ea2022c3441299fa74213e766f736%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/10.jpg saved to cache
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-25 21:45:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 424e80e5-2158-5404-9f08-eae2ff66ecea, skipping ID generation
2026-03-25 21:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424e80e5-2158-5404-9f08-eae2ff66ecea with scrape type 1
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 424e80e5-2158-5404-9f08-eae2ff66ecea sending to next pipeline
2026-03-25 21:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 424e80e5-2158-5404-9f08-eae2ff66ecea, identifier: 1982523
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132610490>
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/5.jpg saved to cache
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a49410>
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/6.jpg saved to cache
2026-03-25 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1982523
2026-03-25 21:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1982523
2026-03-25 21:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1982523 to the API
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '424e80e5-2158-5404-9f08-eae2ff66ecea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Galaxy',
 'odometer': 186955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/6d2ea2022c3441299fa74213e766f736/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD Galaxy FORD Galaxy 2.0 EcoBlue S&S Aut. TITANIUM Kombi, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Galaxy 2.0 EcoBlue S&S Aut. TITANIUM Kombi, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982523%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [ayvens.de] INFO: Saving data for 1982523: {'created_time': 1774475144.219969, 'last_price_update_time': 1774475144.219981, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982523') HTTP/1.1" 204 0
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/7.jpg not downloaded yet
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/8.jpg not downloaded yet
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/9.jpg not downloaded yet
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/10.jpg not downloaded yet
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [ayvens.de] INFO: Found listing with ID: 1982527
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982527%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [ayvens.de] INFO: Scrape type for 1982527: 1
2026-03-25 21:45:44 [ayvens.de] INFO: Extracting data for car ID: 1982527
2026-03-25 21:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1982527
2026-03-25 21:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311d83dc-371b-5211-95e8-9555407fe223 with scrape type 1
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/1.jpg not downloaded yet
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/2.jpg not downloaded yet
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/3.jpg not downloaded yet
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/4.jpg not downloaded yet
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ad150>
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/4.jpg saved to cache
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/5.jpg not downloaded yet
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309f5f90>
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/3.jpg saved to cache
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067d190>
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/1.jpg saved to cache
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/6.jpg not downloaded yet
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/7.jpg not downloaded yet
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130704610>
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/10.jpg saved to cache
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a52550>
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/9.jpg saved to cache
2026-03-25 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087fa50>
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/8.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b689fd0>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/4.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130687710>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/3.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/8.jpg not downloaded yet
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/9.jpg not downloaded yet
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/10.jpg not downloaded yet
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [ayvens.de] INFO: Found listing with ID: 1982528
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982528%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [ayvens.de] INFO: Scrape type for 1982528: 1
2026-03-25 21:45:45 [ayvens.de] INFO: Extracting data for car ID: 1982528
2026-03-25 21:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1982528
2026-03-25 21:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a19b732-745f-542c-b084-ad80d302a120 with scrape type 1
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/1.jpg not downloaded yet
2026-03-25 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/2.jpg not downloaded yet
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/3.jpg not downloaded yet
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/4.jpg not downloaded yet
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a53c10>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/1.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b691c90>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/2.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b63e650>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/10.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/5.jpg not downloaded yet
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2fb50>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/5.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2ea10>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/6.jpg saved to cache
2026-03-25 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305eb350>
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/8.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130350f10>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/7.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/6.jpg not downloaded yet
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/7.jpg not downloaded yet
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130365310>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/9.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/8.jpg not downloaded yet
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/9.jpg not downloaded yet
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b655790>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/8.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/10.jpg not downloaded yet
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [ayvens.de] INFO: Found listing with ID: 1982529
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982529%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [ayvens.de] INFO: Scrape type for 1982529: 1
2026-03-25 21:45:46 [ayvens.de] INFO: Extracting data for car ID: 1982529
2026-03-25 21:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1982529
2026-03-25 21:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 1
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/1.jpg not downloaded yet
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/2.jpg not downloaded yet
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/3.jpg not downloaded yet
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/4.jpg not downloaded yet
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130601490>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/7.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ccfa50>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/6.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/5.jpg not downloaded yet
2026-03-25 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/6.jpg not downloaded yet
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/7.jpg not downloaded yet
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305ea510>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/9.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087cd50>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/4.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309933d0>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/6.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130670fd0>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/5.jpg saved to cache
2026-03-25 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cd6d0>
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/5.jpg saved to cache
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/8.jpg not downloaded yet
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/9.jpg not downloaded yet
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813035ad50>
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/9.jpg saved to cache
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/10.jpg not downloaded yet
2026-03-25 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:47 [ayvens.de] INFO: Found listing with ID: 1982530
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982530%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [ayvens.de] INFO: Scrape type for 1982530: 1
2026-03-25 21:45:47 [ayvens.de] INFO: Extracting data for car ID: 1982530
2026-03-25 21:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf2a41df-eaf2-509b-b65e-ff33a672a994 with identifier: 1982530
2026-03-25 21:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2a41df-eaf2-509b-b65e-ff33a672a994 with scrape type 1
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/1.jpg not downloaded yet
2026-03-25 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/2.jpg not downloaded yet
2026-03-25 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/3.jpg not downloaded yet
2026-03-25 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/4.jpg not downloaded yet
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/5.jpg not downloaded yet
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/6.jpg not downloaded yet
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130975350>
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/8.jpg saved to cache
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a4ab90>
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/7.jpg saved to cache
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/7.jpg not downloaded yet
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/8.jpg not downloaded yet
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/9.jpg not downloaded yet
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a508090>
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/4.jpg saved to cache
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038e1d0>
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/10.jpg saved to cache
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130672910>
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/3.jpg saved to cache
2026-03-25 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308978d0>
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/2.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303a4210>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/6.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/10.jpg not downloaded yet
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [ayvens.de] INFO: Found listing with ID: 1982531
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982531%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [ayvens.de] INFO: Scrape type for 1982531: 1
2026-03-25 21:45:48 [ayvens.de] INFO: Extracting data for car ID: 1982531
2026-03-25 21:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd48a0e4-508f-53e1-af02-e9a44098be70 with identifier: 1982531
2026-03-25 21:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd48a0e4-508f-53e1-af02-e9a44098be70 with scrape type 1
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/1.jpg not downloaded yet
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/2.jpg not downloaded yet
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/3.jpg not downloaded yet
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132217790>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/5.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/4.jpg not downloaded yet
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67f290>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/8.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130375590>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/9.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/5.jpg not downloaded yet
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/6.jpg not downloaded yet
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813e9dc150>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/4.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6ef190>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/10.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67c090>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/5.jpg saved to cache
2026-03-25 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130907510>
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/7.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a53110>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/3.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/7.jpg not downloaded yet
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/8.jpg not downloaded yet
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/9.jpg not downloaded yet
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/10.jpg not downloaded yet
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [ayvens.de] INFO: Found listing with ID: 1982532
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982532%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [ayvens.de] INFO: Scrape type for 1982532: 1
2026-03-25 21:45:49 [ayvens.de] INFO: Extracting data for car ID: 1982532
2026-03-25 21:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6fd199c-32c9-5df8-9774-12e0215536e9 with identifier: 1982532
2026-03-25 21:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fd199c-32c9-5df8-9774-12e0215536e9 with scrape type 1
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/1.jpg not downloaded yet
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/2.jpg not downloaded yet
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/3.jpg not downloaded yet
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a510390>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/10.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a5162d0>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/9.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/4.jpg not downloaded yet
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/5.jpg not downloaded yet
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/6.jpg not downloaded yet
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b643550>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/1.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303517d0>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/8.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b63cd50>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/2.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093f7d0>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/7.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130975e90>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/7.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/7.jpg not downloaded yet
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/8.jpg not downloaded yet
2026-03-25 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2eed0>
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/4.jpg saved to cache
2026-03-25 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/9.jpg not downloaded yet
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/10.jpg not downloaded yet
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [ayvens.de] INFO: Found listing with ID: 1982533
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982533%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [ayvens.de] INFO: Scrape type for 1982533: 1
2026-03-25 21:45:50 [ayvens.de] INFO: Extracting data for car ID: 1982533
2026-03-25 21:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6f61f53-784b-57bf-9fb5-8860ca6c1ec4 with identifier: 1982533
2026-03-25 21:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4 with scrape type 1
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/1.jpg not downloaded yet
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/2.jpg not downloaded yet
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130894d50>
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/8.jpg saved to cache
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ab9510>
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/10.jpg saved to cache
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b5290>
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/6.jpg saved to cache
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/3.jpg not downloaded yet
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f7190>
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/9.jpg saved to cache
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/4.jpg not downloaded yet
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813065b750>
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/4.jpg saved to cache
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130695090>
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/1.jpg saved to cache
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813060bb90>
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/5.jpg saved to cache
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/5.jpg not downloaded yet
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/6.jpg not downloaded yet
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/7.jpg not downloaded yet
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/8.jpg not downloaded yet
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/9.jpg not downloaded yet
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/10.jpg not downloaded yet
2026-03-25 21:45:50 [ayvens.de] INFO: Found listing with ID: 1982534
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982534%27 HTTP/1.1" 200 None
2026-03-25 21:45:50 [ayvens.de] INFO: Scrape type for 1982534: 1
2026-03-25 21:45:50 [ayvens.de] INFO: Extracting data for car ID: 1982534
2026-03-25 21:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cca24b97-472d-5af5-9abf-7dc8aa2b899d with identifier: 1982534
2026-03-25 21:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca24b97-472d-5af5-9abf-7dc8aa2b899d with scrape type 1
2026-03-25 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/1.jpg not downloaded yet
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/2.jpg not downloaded yet
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813060a7d0>
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/3.jpg saved to cache
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306a53d0>
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/6.jpg saved to cache
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/3.jpg not downloaded yet
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130377fd0>
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/8.jpg saved to cache
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/4.jpg not downloaded yet
2026-03-25 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/5.jpg not downloaded yet
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2b150>
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/7.jpg saved to cache
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f7b10>
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/9.jpg saved to cache
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cce90>
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/5.jpg saved to cache
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303752d0>
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/2.jpg saved to cache
2026-03-25 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/6.jpg not downloaded yet
2026-03-25 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/7.jpg not downloaded yet
2026-03-25 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6e7350>
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2e32ab3c595244f1a41dd8782408493e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/10.jpg saved to cache
2026-03-25 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd48a0e4-508f-53e1-af02-e9a44098be70
2026-03-25 21:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd48a0e4-508f-53e1-af02-e9a44098be70, skipping ID generation
2026-03-25 21:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd48a0e4-508f-53e1-af02-e9a44098be70 with scrape type 1
2026-03-25 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd48a0e4-508f-53e1-af02-e9a44098be70 sending to next pipeline
2026-03-25 21:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fd48a0e4-508f-53e1-af02-e9a44098be70, identifier: 1982531
2026-03-25 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/8.jpg not downloaded yet
2026-03-25 21:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fd48a0e4-508f-53e1-af02-e9a44098be70 with identifier: 1982531
2026-03-25 21:45:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fd48a0e4-508f-53e1-af02-e9a44098be70 with identifier: 1982531
2026-03-25 21:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fd48a0e4-508f-53e1-af02-e9a44098be70 with identifier: 1982531 to the API
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fd48a0e4-508f-53e1-af02-e9a44098be70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 58633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd48a0e4-508f-53e1-af02-e9a44098be70/fd48a0e4-508f-53e1-af02-e9a44098be70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2e32ab3c595244f1a41dd8782408493e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982531%27 HTTP/1.1" 200 None
2026-03-25 21:45:52 [ayvens.de] INFO: Saving data for 1982531: {'created_time': 1774475152.786307, 'last_price_update_time': 1774475152.786319, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982531') HTTP/1.1" 204 0
2026-03-25 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/9.jpg not downloaded yet
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130705390>
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/6.jpg saved to cache
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130960d90>
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/7.jpg saved to cache
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130669790>
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/4.jpg saved to cache
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cd850>
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/5.jpg saved to cache
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308ae950>
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/10.jpg saved to cache
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130960ad0>
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/9.jpg saved to cache
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/10.jpg not downloaded yet
2026-03-25 21:45:53 [ayvens.de] INFO: Found listing with ID: 1982535
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982535%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [ayvens.de] INFO: Scrape type for 1982535: 1
2026-03-25 21:45:53 [ayvens.de] INFO: Extracting data for car ID: 1982535
2026-03-25 21:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1982535
2026-03-25 21:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 1
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/1.jpg not downloaded yet
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130609710>
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/3.jpg saved to cache
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/2.jpg not downloaded yet
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/3.jpg not downloaded yet
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/4.jpg not downloaded yet
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/5.jpg not downloaded yet
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/6.jpg not downloaded yet
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/7.jpg not downloaded yet
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/8.jpg not downloaded yet
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/9.jpg not downloaded yet
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/10.jpg not downloaded yet
2026-03-25 21:45:53 [ayvens.de] INFO: Found listing with ID: 1982536
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982536%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [ayvens.de] INFO: Scrape type for 1982536: 1
2026-03-25 21:45:53 [ayvens.de] INFO: Extracting data for car ID: 1982536
2026-03-25 21:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9cd2608-4de7-5fc0-a5c6-851c86a01e7e with identifier: 1982536
2026-03-25 21:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e with scrape type 1
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/1.jpg not downloaded yet
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130904b50>
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/4.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a62c10>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/6.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038e210>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/2.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130364ad0>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/2.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/2.jpg not downloaded yet
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a51b610>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/5.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813221add0>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/3.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66af90>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/7.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308dca90>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/3.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/3.jpg not downloaded yet
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/4.jpg not downloaded yet
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308c4cd0>
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/1.jpg saved to cache
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/5.jpg not downloaded yet
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/6.jpg not downloaded yet
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/7.jpg not downloaded yet
2026-03-25 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/8.jpg not downloaded yet
2026-03-25 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/9.jpg not downloaded yet
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/10.jpg not downloaded yet
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308c5a50>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/5.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309ad790>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/9.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:55 [ayvens.de] INFO: Found listing with ID: 1982537
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982537%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [ayvens.de] INFO: Scrape type for 1982537: 1
2026-03-25 21:45:55 [ayvens.de] INFO: Extracting data for car ID: 1982537
2026-03-25 21:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b58d049-32b4-5dae-86f9-55140e392142 with identifier: 1982537
2026-03-25 21:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b58d049-32b4-5dae-86f9-55140e392142 with scrape type 1
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/1.jpg not downloaded yet
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a83050>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/4.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/2.jpg not downloaded yet
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/3.jpg not downloaded yet
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130350410>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/6.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309ace90>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/7.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130352990>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/8.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309af110>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/10.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b661310>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/3.jpg saved to cache
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/4.jpg not downloaded yet
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/5.jpg not downloaded yet
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/6.jpg not downloaded yet
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/7.jpg not downloaded yet
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/8.jpg not downloaded yet
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/9.jpg not downloaded yet
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/10.jpg not downloaded yet
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a603d0>
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F628ab4c6be7c46d8af66ef54d8b241a0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/10.jpg saved to cache
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cca24b97-472d-5af5-9abf-7dc8aa2b899d
2026-03-25 21:45:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cca24b97-472d-5af5-9abf-7dc8aa2b899d, skipping ID generation
2026-03-25 21:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca24b97-472d-5af5-9abf-7dc8aa2b899d with scrape type 1
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cca24b97-472d-5af5-9abf-7dc8aa2b899d sending to next pipeline
2026-03-25 21:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cca24b97-472d-5af5-9abf-7dc8aa2b899d, identifier: 1982534
2026-03-25 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:56 [ayvens.de] INFO: Found listing with ID: 1982538
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982538%27 HTTP/1.1" 200 None
2026-03-25 21:45:56 [ayvens.de] INFO: Scrape type for 1982538: 1
2026-03-25 21:45:56 [ayvens.de] INFO: Extracting data for car ID: 1982538
2026-03-25 21:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f23685-5e76-5edd-8591-31392e5350ae with identifier: 1982538
2026-03-25 21:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f23685-5e76-5edd-8591-31392e5350ae with scrape type 1
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/1.jpg not downloaded yet
2026-03-25 21:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cca24b97-472d-5af5-9abf-7dc8aa2b899d with identifier: 1982534
2026-03-25 21:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cca24b97-472d-5af5-9abf-7dc8aa2b899d with identifier: 1982534
2026-03-25 21:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cca24b97-472d-5af5-9abf-7dc8aa2b899d with identifier: 1982534 to the API
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cca24b97-472d-5af5-9abf-7dc8aa2b899d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-Max',
 'odometer': 101794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca24b97-472d-5af5-9abf-7dc8aa2b899d/cca24b97-472d-5af5-9abf-7dc8aa2b899d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/628ab4c6be7c46d8af66ef54d8b241a0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD S-Max FORD S-Max 2.0 EcoBlue Aut. TREND Kombi, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD S-Max 2.0 EcoBlue Aut. TREND Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982534%27 HTTP/1.1" 200 None
2026-03-25 21:45:56 [ayvens.de] INFO: Saving data for 1982534: {'created_time': 1774475156.740616, 'last_price_update_time': 1774475156.740627, 'auction_closing_time': 1774533600.0}
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982534') HTTP/1.1" 204 0
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/2.jpg not downloaded yet
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/3.jpg not downloaded yet
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813034b010>
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/1.jpg saved to cache
2026-03-25 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130896550>
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/9.jpg saved to cache
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a35250>
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/2.jpg saved to cache
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306a7750>
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/2.jpg saved to cache
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a51dd0>
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/10.jpg saved to cache
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b665a90>
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/1.jpg saved to cache
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306a5b90>
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/4.jpg saved to cache
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/4.jpg not downloaded yet
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/5.jpg not downloaded yet
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/6.jpg not downloaded yet
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/7.jpg not downloaded yet
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/8.jpg not downloaded yet
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/9.jpg not downloaded yet
2026-03-25 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/10.jpg not downloaded yet
2026-03-25 21:45:57 [ayvens.de] INFO: Found listing with ID: 1982539
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982539%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [ayvens.de] INFO: Scrape type for 1982539: 1
2026-03-25 21:45:57 [ayvens.de] INFO: Extracting data for car ID: 1982539
2026-03-25 21:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4919e9c-2cf3-5d66-b86f-5f65ae50dec8 with identifier: 1982539
2026-03-25 21:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8 with scrape type 1
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/1.jpg not downloaded yet
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a34cd0>
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/4.jpg saved to cache
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/2.jpg not downloaded yet
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038c390>
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/3.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6e76d0>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/9.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6b3fd0>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/8.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a514810>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/1.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/3.jpg not downloaded yet
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/4.jpg not downloaded yet
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130614810>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/6.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130686f90>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/5.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093c490>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/10.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/5.jpg not downloaded yet
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/6.jpg not downloaded yet
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/7.jpg not downloaded yet
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/8.jpg not downloaded yet
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/9.jpg not downloaded yet
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/10.jpg not downloaded yet
2026-03-25 21:45:58 [ayvens.de] INFO: Found listing with ID: 1982540
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982540%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [ayvens.de] INFO: Scrape type for 1982540: 1
2026-03-25 21:45:58 [ayvens.de] INFO: Extracting data for car ID: 1982540
2026-03-25 21:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34b8f902-f912-5a61-9ee6-2df5940bac13 with identifier: 1982540
2026-03-25 21:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34b8f902-f912-5a61-9ee6-2df5940bac13 with scrape type 1
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/1.jpg not downloaded yet
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/2.jpg not downloaded yet
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813061c310>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/4.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087da90>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/5.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130658a50>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/3.jpg saved to cache
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/3.jpg not downloaded yet
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66a390>
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/3.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306857d0>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/2.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/4.jpg not downloaded yet
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/5.jpg not downloaded yet
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130684a50>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/6.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6d6610>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/4.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d6cdd0>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/7.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/6.jpg not downloaded yet
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/7.jpg not downloaded yet
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/8.jpg not downloaded yet
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/9.jpg not downloaded yet
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/10.jpg not downloaded yet
2026-03-25 21:45:59 [ayvens.de] INFO: Found listing with ID: 1982541
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982541%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [ayvens.de] INFO: Scrape type for 1982541: 1
2026-03-25 21:45:59 [ayvens.de] INFO: Extracting data for car ID: 1982541
2026-03-25 21:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d658ee-dc39-58d2-83d3-b22a93f48be7 with identifier: 1982541
2026-03-25 21:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d658ee-dc39-58d2-83d3-b22a93f48be7 with scrape type 1
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/1.jpg not downloaded yet
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/2.jpg not downloaded yet
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a508890>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/1.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67e290>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/5.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a51a390>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/6.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/3.jpg not downloaded yet
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/4.jpg not downloaded yet
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813061f750>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/8.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130687010>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/3.jpg saved to cache
2026-03-25 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130976910>
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/10.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130695d50>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/9.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/5.jpg not downloaded yet
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/6.jpg not downloaded yet
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087ec10>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/5.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067cd50>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/2.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/7.jpg not downloaded yet
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/8.jpg not downloaded yet
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/9.jpg not downloaded yet
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306006d0>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/6.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a501f10>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/4.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/10.jpg not downloaded yet
2026-03-25 21:46:00 [ayvens.de] INFO: Found listing with ID: 1982542
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982542%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [ayvens.de] INFO: Scrape type for 1982542: 1
2026-03-25 21:46:00 [ayvens.de] INFO: Extracting data for car ID: 1982542
2026-03-25 21:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2ac5847-9796-5cb7-bedc-a81d1ed43107 with identifier: 1982542
2026-03-25 21:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ac5847-9796-5cb7-bedc-a81d1ed43107 with scrape type 1
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/1.jpg not downloaded yet
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d14d50>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/1.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a500d0>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/7.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f7650>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/3.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303585d0>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/2.jpg saved to cache
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/2.jpg not downloaded yet
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/3.jpg not downloaded yet
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/4.jpg not downloaded yet
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303852d0>
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/1.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/5.jpg not downloaded yet
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/6.jpg not downloaded yet
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6af950>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/4.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/7.jpg not downloaded yet
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/8.jpg not downloaded yet
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/9.jpg not downloaded yet
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132505310>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/5.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813097efd0>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/6.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b654d50>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/10.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306e9d10>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/7.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ab42d0>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/9.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/10.jpg not downloaded yet
2026-03-25 21:46:01 [ayvens.de] INFO: Found listing with ID: 1982543
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982543%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [ayvens.de] INFO: Scrape type for 1982543: 1
2026-03-25 21:46:01 [ayvens.de] INFO: Extracting data for car ID: 1982543
2026-03-25 21:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2269cc8-abd8-5896-9d38-3ba8d9636c67 with identifier: 1982543
2026-03-25 21:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2269cc8-abd8-5896-9d38-3ba8d9636c67 with scrape type 1
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/1.jpg not downloaded yet
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b61210>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/3.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/2.jpg not downloaded yet
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/3.jpg not downloaded yet
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/4.jpg not downloaded yet
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132a1bcd0>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/2.jpg saved to cache
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/5.jpg not downloaded yet
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/6.jpg not downloaded yet
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130894190>
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/1.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130609710>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/7.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a35790>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/5.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130384d50>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/10.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/7.jpg not downloaded yet
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/8.jpg not downloaded yet
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/9.jpg not downloaded yet
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a36790>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/8.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303760d0>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/4.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130384410>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/6.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/10.jpg not downloaded yet
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [ayvens.de] INFO: Found listing with ID: 1982544
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982544%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [ayvens.de] INFO: Scrape type for 1982544: 1
2026-03-25 21:46:02 [ayvens.de] INFO: Extracting data for car ID: 1982544
2026-03-25 21:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1982544
2026-03-25 21:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 1
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/1.jpg not downloaded yet
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/2.jpg not downloaded yet
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/3.jpg not downloaded yet
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/4.jpg not downloaded yet
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306730d0>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/10.jpg saved to cache
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/5.jpg not downloaded yet
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/6.jpg not downloaded yet
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/7.jpg not downloaded yet
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087fc10>
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/1.jpg saved to cache
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087d290>
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/3.jpg saved to cache
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b88410>
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbb-%252F84eba1b16b6d48bab84edf3a01300766%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/9.jpg saved to cache
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5d658ee-dc39-58d2-83d3-b22a93f48be7
2026-03-25 21:46:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5d658ee-dc39-58d2-83d3-b22a93f48be7, skipping ID generation
2026-03-25 21:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d658ee-dc39-58d2-83d3-b22a93f48be7 with scrape type 1
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5d658ee-dc39-58d2-83d3-b22a93f48be7 sending to next pipeline
2026-03-25 21:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f5d658ee-dc39-58d2-83d3-b22a93f48be7, identifier: 1982541
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b62ffd0>
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/2.jpg saved to cache
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cfd50>
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/4.jpg saved to cache
2026-03-25 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a510050>
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/6.jpg saved to cache
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f5d658ee-dc39-58d2-83d3-b22a93f48be7 with identifier: 1982541
2026-03-25 21:46:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f5d658ee-dc39-58d2-83d3-b22a93f48be7 with identifier: 1982541
2026-03-25 21:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f5d658ee-dc39-58d2-83d3-b22a93f48be7 with identifier: 1982541 to the API
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f5d658ee-dc39-58d2-83d3-b22a93f48be7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 106422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d658ee-dc39-58d2-83d3-b22a93f48be7/f5d658ee-dc39-58d2-83d3-b22a93f48be7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bb-/84eba1b16b6d48bab84edf3a01300766/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE HYUNDAI SANTA FE 2.2 CRDi 4WD Signature '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI SANTA FE 2.2 CRDi 4WD Signature Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982541%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [ayvens.de] INFO: Saving data for 1982541: {'created_time': 1774475164.430887, 'last_price_update_time': 1774475164.430898, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982541') HTTP/1.1" 204 0
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/8.jpg not downloaded yet
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/9.jpg not downloaded yet
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130668390>
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/9.jpg saved to cache
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/10.jpg not downloaded yet
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [ayvens.de] INFO: Found listing with ID: 1982545
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982545%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [ayvens.de] INFO: Scrape type for 1982545: 1
2026-03-25 21:46:04 [ayvens.de] INFO: Extracting data for car ID: 1982545
2026-03-25 21:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc49bbfb-03ed-592b-9085-39fc3055ea45 with identifier: 1982545
2026-03-25 21:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc49bbfb-03ed-592b-9085-39fc3055ea45 with scrape type 1
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/1.jpg not downloaded yet
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/2.jpg not downloaded yet
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a50a750>
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/9.jpg saved to cache
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/3.jpg not downloaded yet
2026-03-25 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/4.jpg not downloaded yet
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309f7010>
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/3.jpg saved to cache
2026-03-25 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303a5110>
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/1.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130aa1090>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/10.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81326122d0>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/8.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303a7010>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/2.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/5.jpg not downloaded yet
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/6.jpg not downloaded yet
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/7.jpg not downloaded yet
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130375c10>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/4.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66bb50>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/7.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/8.jpg not downloaded yet
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/9.jpg not downloaded yet
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/10.jpg not downloaded yet
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [ayvens.de] INFO: Found listing with ID: 1982546
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982546%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [ayvens.de] INFO: Scrape type for 1982546: 1
2026-03-25 21:46:05 [ayvens.de] INFO: Extracting data for car ID: 1982546
2026-03-25 21:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91af6394-a124-5663-b677-08b63f5fccab with identifier: 1982546
2026-03-25 21:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91af6394-a124-5663-b677-08b63f5fccab with scrape type 1
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/1.jpg not downloaded yet
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/2.jpg not downloaded yet
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/3.jpg not downloaded yet
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ac310>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/9.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/4.jpg not downloaded yet
2026-03-25 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/5.jpg not downloaded yet
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/6.jpg not downloaded yet
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66bf90>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/7.jpg saved to cache
2026-03-25 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067f190>
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/1.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b664050>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/5.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308af350>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/10.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a500bd0>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/8.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a500550>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/6.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/7.jpg not downloaded yet
2026-03-25 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/8.jpg not downloaded yet
2026-03-25 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a37590>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/4.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/9.jpg not downloaded yet
2026-03-25 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/10.jpg not downloaded yet
2026-03-25 21:46:06 [ayvens.de] INFO: Found listing with ID: 1982547
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982547%27 HTTP/1.1" 200 None
2026-03-25 21:46:06 [ayvens.de] INFO: Scrape type for 1982547: 1
2026-03-25 21:46:06 [ayvens.de] INFO: Extracting data for car ID: 1982547
2026-03-25 21:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768d0781-8d3e-597e-a18a-76d9b4eaecf9 with identifier: 1982547
2026-03-25 21:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9 with scrape type 1
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/1.jpg not downloaded yet
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81321ef910>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/9.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093d9d0>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/10.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 7 pages/min), scraped 9 items (at 9 items/min)
2026-03-25 21:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/2.jpg not downloaded yet
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303ad150>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/1.jpg saved to cache
2026-03-25 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130976b50>
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/8.jpg saved to cache
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/3.jpg not downloaded yet
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130976fd0>
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/2.jpg saved to cache
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130685150>
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F315d3d757a2f4536b595efbeacc91faa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/3.jpg saved to cache
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-25 21:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6209d459-4198-5691-9aab-360956f8f4d6, skipping ID generation
2026-03-25 21:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 1
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6209d459-4198-5691-9aab-360956f8f4d6 sending to next pipeline
2026-03-25 21:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6209d459-4198-5691-9aab-360956f8f4d6, identifier: 1982544
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087f090>
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/4.jpg saved to cache
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/4.jpg not downloaded yet
2026-03-25 21:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1982544
2026-03-25 21:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1982544
2026-03-25 21:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1982544 to the API
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '6209d459-4198-5691-9aab-360956f8f4d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Vito / Marco Polo',
 'odometer': 107057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/315d3d757a2f4536b595efbeacc91faa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Vito / Marco Polo MERCEDES-BENZ Vito 114 CDI Lang HA '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ Vito 114 CDI Lang HA Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982544%27 HTTP/1.1" 200 None
2026-03-25 21:46:07 [ayvens.de] INFO: Saving data for 1982544: {'created_time': 1774475167.926937, 'last_price_update_time': 1774475167.926952, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982544') HTTP/1.1" 204 0
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/5.jpg not downloaded yet
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6cbdd0>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/5.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/6.jpg not downloaded yet
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/7.jpg not downloaded yet
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/8.jpg not downloaded yet
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ab5710>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/7.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813097ff10>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/8.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/9.jpg not downloaded yet
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/10.jpg not downloaded yet
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a49050>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/6.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132217c90>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/3.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130659f50>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/2.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309afc50>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/9.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:46:08 [ayvens.de] INFO: Found listing with ID: 1982548
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982548%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [ayvens.de] INFO: Scrape type for 1982548: 1
2026-03-25 21:46:08 [ayvens.de] INFO: Extracting data for car ID: 1982548
2026-03-25 21:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc548c7a-fde5-5719-bd95-11de7881aa2f with identifier: 1982548
2026-03-25 21:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc548c7a-fde5-5719-bd95-11de7881aa2f with scrape type 1
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/1.jpg not downloaded yet
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/2.jpg not downloaded yet
2026-03-25 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/3.jpg not downloaded yet
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067e190>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/5.jpg saved to cache
2026-03-25 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067e690>
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/6.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/4.jpg not downloaded yet
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/5.jpg not downloaded yet
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6c2690>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/8.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/6.jpg not downloaded yet
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/7.jpg not downloaded yet
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/8.jpg not downloaded yet
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036fa50>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/7.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130963550>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/4.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a81850>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/3.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130671a90>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/2.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/9.jpg not downloaded yet
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/10.jpg not downloaded yet
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a82750>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/9.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a485d0>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/1.jpg saved to cache
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:09 [ayvens.de] INFO: Found listing with ID: 1982549
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982549%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [ayvens.de] INFO: Scrape type for 1982549: 1
2026-03-25 21:46:09 [ayvens.de] INFO: Extracting data for car ID: 1982549
2026-03-25 21:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444a2729-b457-5567-a24c-0df1415979e7 with identifier: 1982549
2026-03-25 21:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444a2729-b457-5567-a24c-0df1415979e7 with scrape type 1
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/1.jpg not downloaded yet
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/2.jpg not downloaded yet
2026-03-25 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/3.jpg not downloaded yet
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038c8d0>
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/10.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/4.jpg not downloaded yet
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/5.jpg not downloaded yet
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f4250>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/3.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303a6b50>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/4.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/6.jpg not downloaded yet
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/7.jpg not downloaded yet
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/8.jpg not downloaded yet
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b602d0>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/2.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6892d0>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/5.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b692e90>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/6.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307f7890>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/7.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308dfb90>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/8.jpg saved to cache
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/9.jpg not downloaded yet
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/10.jpg not downloaded yet
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [ayvens.de] INFO: Found listing with ID: 1982550
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982550%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [ayvens.de] INFO: Scrape type for 1982550: 1
2026-03-25 21:46:10 [ayvens.de] INFO: Extracting data for car ID: 1982550
2026-03-25 21:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd7d43a4-91c0-57c7-a190-cdd52a7e8669 with identifier: 1982550
2026-03-25 21:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669 with scrape type 1
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/1.jpg not downloaded yet
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/2.jpg not downloaded yet
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/3.jpg not downloaded yet
2026-03-25 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/4.jpg not downloaded yet
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303c12d0>
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/2.jpg saved to cache
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b68b490>
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/9.jpg saved to cache
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a509c50>
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252F84a8e92a51564bd5bdf30a8bee6fc391%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/10.jpg saved to cache
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9
2026-03-25 21:46:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 768d0781-8d3e-597e-a18a-76d9b4eaecf9, skipping ID generation
2026-03-25 21:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9 with scrape type 1
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 768d0781-8d3e-597e-a18a-76d9b4eaecf9 sending to next pipeline
2026-03-25 21:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 768d0781-8d3e-597e-a18a-76d9b4eaecf9, identifier: 1982547
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6576d0>
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/1.jpg saved to cache
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b640c90>
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/5.jpg saved to cache
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/5.jpg not downloaded yet
2026-03-25 21:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 768d0781-8d3e-597e-a18a-76d9b4eaecf9 with identifier: 1982547
2026-03-25 21:46:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 768d0781-8d3e-597e-a18a-76d9b4eaecf9 with identifier: 1982547
2026-03-25 21:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 768d0781-8d3e-597e-a18a-76d9b4eaecf9 with identifier: 1982547 to the API
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Void',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '768d0781-8d3e-597e-a18a-76d9b4eaecf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 26853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768d0781-8d3e-597e-a18a-76d9b4eaecf9/768d0781-8d3e-597e-a18a-76d9b4eaecf9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/84a8e92a51564bd5bdf30a8bee6fc391/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Single Motor 64kWh '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Single Motor 64kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982547%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [ayvens.de] INFO: Saving data for 1982547: {'created_time': 1774475172.065649, 'last_price_update_time': 1774475172.06566, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982547') HTTP/1.1" 204 0
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b668190>
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/3.jpg saved to cache
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130661b90>
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/6.jpg saved to cache
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/6.jpg not downloaded yet
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/7.jpg not downloaded yet
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309515d0>
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fae507a8faa4947b2a297f4587a3cf6e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/1.jpg saved to cache
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91af6394-a124-5663-b677-08b63f5fccab
2026-03-25 21:46:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91af6394-a124-5663-b677-08b63f5fccab, skipping ID generation
2026-03-25 21:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91af6394-a124-5663-b677-08b63f5fccab with scrape type 1
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91af6394-a124-5663-b677-08b63f5fccab sending to next pipeline
2026-03-25 21:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 91af6394-a124-5663-b677-08b63f5fccab, identifier: 1982546
2026-03-25 21:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 91af6394-a124-5663-b677-08b63f5fccab with identifier: 1982546
2026-03-25 21:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 91af6394-a124-5663-b677-08b63f5fccab with identifier: 1982546
2026-03-25 21:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 91af6394-a124-5663-b677-08b63f5fccab with identifier: 1982546 to the API
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '91af6394-a124-5663-b677-08b63f5fccab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 87134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91af6394-a124-5663-b677-08b63f5fccab/91af6394-a124-5663-b677-08b63f5fccab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/ae507a8faa4947b2a297f4587a3cf6e7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Dual Motor 78kWh Limousine, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Dual Motor 78kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982546%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [ayvens.de] INFO: Saving data for 1982546: {'created_time': 1774475172.836536, 'last_price_update_time': 1774475172.836547, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982546') HTTP/1.1" 204 0
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/8.jpg not downloaded yet
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/9.jpg not downloaded yet
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/10.jpg not downloaded yet
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [ayvens.de] INFO: Found listing with ID: 1982551
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982551%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [ayvens.de] INFO: Scrape type for 1982551: 1
2026-03-25 21:46:12 [ayvens.de] INFO: Extracting data for car ID: 1982551
2026-03-25 21:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44997739-ac1d-5709-b123-d9e22c114be1 with identifier: 1982551
2026-03-25 21:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44997739-ac1d-5709-b123-d9e22c114be1 with scrape type 1
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/1.jpg not downloaded yet
2026-03-25 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/2.jpg not downloaded yet
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/3.jpg not downloaded yet
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/4.jpg not downloaded yet
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6efed0>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/9.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/5.jpg not downloaded yet
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064bf10>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/2.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b692610>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/10.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/6.jpg not downloaded yet
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a34c50>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/6.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66bd50>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/3.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6d5410>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/4.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130654d50>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/5.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308c46d0>
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/1.jpg saved to cache
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/7.jpg not downloaded yet
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/8.jpg not downloaded yet
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/9.jpg not downloaded yet
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/10.jpg not downloaded yet
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:13 [ayvens.de] INFO: Found listing with ID: 1982552
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982552%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [ayvens.de] INFO: Scrape type for 1982552: 1
2026-03-25 21:46:13 [ayvens.de] INFO: Extracting data for car ID: 1982552
2026-03-25 21:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1820950e-df53-5b89-afa1-ade7a9d49e89 with identifier: 1982552
2026-03-25 21:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1820950e-df53-5b89-afa1-ade7a9d49e89 with scrape type 1
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/1.jpg not downloaded yet
2026-03-25 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/2.jpg not downloaded yet
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a29b90>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/10.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813065a690>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/9.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/3.jpg not downloaded yet
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305fd310>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/5.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/4.jpg not downloaded yet
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/5.jpg not downloaded yet
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309d0a90>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/8.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067f190>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fbea19acae7e84dbba0cdd01939499070%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/7.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 444a2729-b457-5567-a24c-0df1415979e7
2026-03-25 21:46:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 444a2729-b457-5567-a24c-0df1415979e7, skipping ID generation
2026-03-25 21:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444a2729-b457-5567-a24c-0df1415979e7 with scrape type 1
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 444a2729-b457-5567-a24c-0df1415979e7 sending to next pipeline
2026-03-25 21:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 444a2729-b457-5567-a24c-0df1415979e7, identifier: 1982549
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132611b10>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/3.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130626c50>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/1.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b667a10>
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/4.jpg saved to cache
2026-03-25 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 444a2729-b457-5567-a24c-0df1415979e7 with identifier: 1982549
2026-03-25 21:46:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 444a2729-b457-5567-a24c-0df1415979e7 with identifier: 1982549
2026-03-25 21:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 444a2729-b457-5567-a24c-0df1415979e7 with identifier: 1982549 to the API
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '444a2729-b457-5567-a24c-0df1415979e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 37612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444a2729-b457-5567-a24c-0df1415979e7/444a2729-b457-5567-a24c-0df1415979e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/bea19acae7e84dbba0cdd01939499070/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Single Motor 78kWh '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Single Motor 78kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982549%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [ayvens.de] INFO: Saving data for 1982549: {'created_time': 1774475175.352294, 'last_price_update_time': 1774475175.352305, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982549') HTTP/1.1" 204 0
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/6.jpg not downloaded yet
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/7.jpg not downloaded yet
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/8.jpg not downloaded yet
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/9.jpg not downloaded yet
2026-03-25 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/10.jpg not downloaded yet
2026-03-25 21:46:15 [ayvens.de] INFO: Found listing with ID: 1982553
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982553%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [ayvens.de] INFO: Scrape type for 1982553: 1
2026-03-25 21:46:15 [ayvens.de] INFO: Extracting data for car ID: 1982553
2026-03-25 21:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efa07153-df1f-5020-8a6f-210afd79d1f0 with identifier: 1982553
2026-03-25 21:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa07153-df1f-5020-8a6f-210afd79d1f0 with scrape type 1
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/1.jpg not downloaded yet
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/2.jpg not downloaded yet
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a50b450>
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/7.jpg saved to cache
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6d4f50>
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/8.jpg saved to cache
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813066b290>
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/4.jpg saved to cache
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/3.jpg not downloaded yet
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b656810>
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/9.jpg saved to cache
2026-03-25 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130907690>
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/5.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67f110>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/3.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130614d50>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/2.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6d7450>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/6.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/4.jpg not downloaded yet
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/5.jpg not downloaded yet
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/6.jpg not downloaded yet
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/7.jpg not downloaded yet
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/8.jpg not downloaded yet
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/9.jpg not downloaded yet
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/10.jpg not downloaded yet
2026-03-25 21:46:16 [ayvens.de] INFO: Found listing with ID: 1982554
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982554%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [ayvens.de] INFO: Scrape type for 1982554: 1
2026-03-25 21:46:16 [ayvens.de] INFO: Extracting data for car ID: 1982554
2026-03-25 21:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c with identifier: 1982554
2026-03-25 21:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c with scrape type 1
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/1.jpg not downloaded yet
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/2.jpg not downloaded yet
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130904d90>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/8.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2f690>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/3.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2c310>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/10.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130975090>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/2.jpg saved to cache
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/3.jpg not downloaded yet
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ac0d0>
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/1.jpg saved to cache
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309d3010>
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/7.jpg saved to cache
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/4.jpg not downloaded yet
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/5.jpg not downloaded yet
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813097d290>
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/1.jpg saved to cache
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a4b510>
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/10.jpg saved to cache
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/6.jpg not downloaded yet
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/7.jpg not downloaded yet
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/8.jpg not downloaded yet
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/9.jpg not downloaded yet
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/10.jpg not downloaded yet
2026-03-25 21:46:17 [ayvens.de] INFO: Found listing with ID: 1982555
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982555%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [ayvens.de] INFO: Scrape type for 1982555: 1
2026-03-25 21:46:17 [ayvens.de] INFO: Extracting data for car ID: 1982555
2026-03-25 21:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d776eb25-d7fd-58f7-af2e-ffb6c15c429e with identifier: 1982555
2026-03-25 21:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e with scrape type 1
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/1.jpg not downloaded yet
2026-03-25 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/2.jpg not downloaded yet
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130662c90>
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/6.jpg saved to cache
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/3.jpg not downloaded yet
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/4.jpg not downloaded yet
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130968350>
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/4.jpg saved to cache
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ac8690>
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/6.jpg saved to cache
2026-03-25 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307f6710>
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/5.jpg saved to cache
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303507d0>
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/7.jpg saved to cache
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130673650>
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/3.jpg saved to cache
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036d110>
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F9d412aa8cb0044aeb4bca63a5dc433a0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/9.jpg saved to cache
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44997739-ac1d-5709-b123-d9e22c114be1
2026-03-25 21:46:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44997739-ac1d-5709-b123-d9e22c114be1, skipping ID generation
2026-03-25 21:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44997739-ac1d-5709-b123-d9e22c114be1 with scrape type 1
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44997739-ac1d-5709-b123-d9e22c114be1 sending to next pipeline
2026-03-25 21:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 44997739-ac1d-5709-b123-d9e22c114be1, identifier: 1982551
2026-03-25 21:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 44997739-ac1d-5709-b123-d9e22c114be1 with identifier: 1982551
2026-03-25 21:46:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 44997739-ac1d-5709-b123-d9e22c114be1 with identifier: 1982551
2026-03-25 21:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 44997739-ac1d-5709-b123-d9e22c114be1 with identifier: 1982551 to the API
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '44997739-ac1d-5709-b123-d9e22c114be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 133861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44997739-ac1d-5709-b123-d9e22c114be1/44997739-ac1d-5709-b123-d9e22c114be1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/9d412aa8cb0044aeb4bca63a5dc433a0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Spirit Kombi, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Spirit Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982551%27 HTTP/1.1" 200 None
2026-03-25 21:46:18 [ayvens.de] INFO: Saving data for 1982551: {'created_time': 1774475178.949751, 'last_price_update_time': 1774475178.949761, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982551') HTTP/1.1" 204 0
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/5.jpg not downloaded yet
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b72110>
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/2.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/6.jpg not downloaded yet
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/7.jpg not downloaded yet
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/8.jpg not downloaded yet
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/9.jpg not downloaded yet
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/10.jpg not downloaded yet
2026-03-25 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:19 [ayvens.de] INFO: Found listing with ID: 1982556
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982556%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [ayvens.de] INFO: Scrape type for 1982556: 1
2026-03-25 21:46:19 [ayvens.de] INFO: Extracting data for car ID: 1982556
2026-03-25 21:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b348b7-eba5-55eb-8e5b-a5355c32d142 with identifier: 1982556
2026-03-25 21:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b348b7-eba5-55eb-8e5b-a5355c32d142 with scrape type 1
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/1.jpg not downloaded yet
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/2.jpg not downloaded yet
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303a5ad0>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/3.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6c2e10>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/4.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309931d0>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/10.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b96f10>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/5.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130950810>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/1.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/3.jpg not downloaded yet
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b68b210>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/6.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130694f10>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/2.jpg saved to cache
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/4.jpg not downloaded yet
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/5.jpg not downloaded yet
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a515690>
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/9.jpg saved to cache
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/6.jpg not downloaded yet
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/7.jpg not downloaded yet
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/8.jpg not downloaded yet
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/9.jpg not downloaded yet
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/10.jpg not downloaded yet
2026-03-25 21:46:20 [ayvens.de] INFO: Found listing with ID: 1982557
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982557%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [ayvens.de] INFO: Scrape type for 1982557: 1
2026-03-25 21:46:20 [ayvens.de] INFO: Extracting data for car ID: 1982557
2026-03-25 21:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898c03d8-00be-546b-b630-ee73f68941f2 with identifier: 1982557
2026-03-25 21:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898c03d8-00be-546b-b630-ee73f68941f2 with scrape type 1
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/1.jpg not downloaded yet
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b643c50>
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/6.jpg saved to cache
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81324f3dd0>
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/1.jpg saved to cache
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/2.jpg not downloaded yet
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81321db710>
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/5.jpg saved to cache
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b418d0>
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/7.jpg saved to cache
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132501990>
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/5.jpg saved to cache
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6b13d0>
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/4.jpg saved to cache
2026-03-25 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b664c90>
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/3.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/3.jpg not downloaded yet
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/4.jpg not downloaded yet
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b72010>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/4.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/5.jpg not downloaded yet
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/6.jpg not downloaded yet
2026-03-25 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/7.jpg not downloaded yet
2026-03-25 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/8.jpg not downloaded yet
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/9.jpg not downloaded yet
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/10.jpg not downloaded yet
2026-03-25 21:46:21 [ayvens.de] INFO: Found listing with ID: 1982558
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982558%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [ayvens.de] INFO: Scrape type for 1982558: 1
2026-03-25 21:46:21 [ayvens.de] INFO: Extracting data for car ID: 1982558
2026-03-25 21:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db95b704-3f8c-59df-a904-76f06a5d30f6 with identifier: 1982558
2026-03-25 21:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db95b704-3f8c-59df-a904-76f06a5d30f6 with scrape type 1
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/1.jpg not downloaded yet
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/2.jpg not downloaded yet
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b63e690>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/7.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308af710>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/2.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c769d0>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/1.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130397c50>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/8.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c64250>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/6.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b63d310>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/3.jpg saved to cache
2026-03-25 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a37e50>
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/10.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/3.jpg not downloaded yet
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/4.jpg not downloaded yet
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/5.jpg not downloaded yet
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/6.jpg not downloaded yet
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/7.jpg not downloaded yet
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/8.jpg not downloaded yet
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/9.jpg not downloaded yet
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/10.jpg not downloaded yet
2026-03-25 21:46:22 [ayvens.de] INFO: Found listing with ID: 1982559
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982559%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [ayvens.de] INFO: Scrape type for 1982559: 1
2026-03-25 21:46:22 [ayvens.de] INFO: Extracting data for car ID: 1982559
2026-03-25 21:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bad8d1d8-884d-56b1-9bec-c8788c580c25 with identifier: 1982559
2026-03-25 21:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bad8d1d8-884d-56b1-9bec-c8788c580c25 with scrape type 1
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/1.jpg not downloaded yet
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/2.jpg not downloaded yet
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a500490>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/2.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813097f250>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/5.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/3.jpg not downloaded yet
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067e690>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/1.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/4.jpg not downloaded yet
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/5.jpg not downloaded yet
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308f9990>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/1.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309986d0>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/7.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130976310>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/4.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130696e10>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/2.jpg saved to cache
2026-03-25 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a5016d0>
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/6.jpg saved to cache
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/6.jpg not downloaded yet
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/7.jpg not downloaded yet
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/8.jpg not downloaded yet
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/9.jpg not downloaded yet
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/10.jpg not downloaded yet
2026-03-25 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:23 [ayvens.de] INFO: Found listing with ID: 1982560
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982560%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [ayvens.de] INFO: Scrape type for 1982560: 1
2026-03-25 21:46:23 [ayvens.de] INFO: Extracting data for car ID: 1982560
2026-03-25 21:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87dd26aa-66df-5e81-a34b-2ab0b9dab4be with identifier: 1982560
2026-03-25 21:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be with scrape type 1
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/1.jpg not downloaded yet
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/2.jpg not downloaded yet
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/3.jpg not downloaded yet
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130968f10>
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/6.jpg saved to cache
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b73450>
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/3.jpg saved to cache
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ccca50>
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/2.jpg saved to cache
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ebf50>
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/10.jpg saved to cache
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ccf6d0>
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/4.jpg saved to cache
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813069ebd0>
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/1.jpg saved to cache
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/4.jpg not downloaded yet
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a602d0>
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/5.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/5.jpg not downloaded yet
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/6.jpg not downloaded yet
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307f4950>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/3.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/7.jpg not downloaded yet
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/8.jpg not downloaded yet
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/9.jpg not downloaded yet
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/10.jpg not downloaded yet
2026-03-25 21:46:24 [ayvens.de] INFO: Found listing with ID: 1982561
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982561%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [ayvens.de] INFO: Scrape type for 1982561: 1
2026-03-25 21:46:24 [ayvens.de] INFO: Extracting data for car ID: 1982561
2026-03-25 21:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3 with identifier: 1982561
2026-03-25 21:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3 with scrape type 1
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/1.jpg not downloaded yet
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/2.jpg not downloaded yet
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bc8ad0>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/6.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/3.jpg not downloaded yet
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69dd90>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/5.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/4.jpg not downloaded yet
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/5.jpg not downloaded yet
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bcae10>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/4.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2d110>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/9.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b42610>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/10.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130894a90>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/3.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69f8d0>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/2.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132b19f50>
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/7.jpg saved to cache
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/6.jpg not downloaded yet
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/7.jpg not downloaded yet
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/8.jpg not downloaded yet
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/9.jpg not downloaded yet
2026-03-25 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/10.jpg not downloaded yet
2026-03-25 21:46:25 [ayvens.de] INFO: Found listing with ID: 1982562
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982562%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [ayvens.de] INFO: Scrape type for 1982562: 1
2026-03-25 21:46:25 [ayvens.de] INFO: Extracting data for car ID: 1982562
2026-03-25 21:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47684643-4d92-51a0-af36-a2b15c10f652 with identifier: 1982562
2026-03-25 21:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47684643-4d92-51a0-af36-a2b15c10f652 with scrape type 1
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/1.jpg not downloaded yet
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/2.jpg not downloaded yet
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305e9b90>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/7.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/3.jpg not downloaded yet
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130aa0210>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/4.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130963dd0>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/3.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/4.jpg not downloaded yet
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/5.jpg not downloaded yet
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306550d0>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/4.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6d4cd0>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/6.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ccd090>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/1.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c66f50>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/2.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/6.jpg not downloaded yet
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/7.jpg not downloaded yet
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813087cc90>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/5.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/8.jpg not downloaded yet
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/9.jpg not downloaded yet
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/10.jpg not downloaded yet
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308fa750>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/8.jpg saved to cache
2026-03-25 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303a42d0>
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/5.jpg saved to cache
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306d91d0>
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/4.jpg saved to cache
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:26 [ayvens.de] INFO: Found listing with ID: 1982563
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982563%27 HTTP/1.1" 200 None
2026-03-25 21:46:26 [ayvens.de] INFO: Scrape type for 1982563: 1
2026-03-25 21:46:26 [ayvens.de] INFO: Extracting data for car ID: 1982563
2026-03-25 21:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e50329b5-3250-5dfe-bcf4-da8acec6be94 with identifier: 1982563
2026-03-25 21:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50329b5-3250-5dfe-bcf4-da8acec6be94 with scrape type 1
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/1.jpg not downloaded yet
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/2.jpg not downloaded yet
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130654850>
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/6.jpg saved to cache
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b642150>
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/7.jpg saved to cache
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813035b710>
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/2.jpg saved to cache
2026-03-25 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132b53090>
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/3.jpg saved to cache
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/3.jpg not downloaded yet
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/4.jpg not downloaded yet
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/5.jpg not downloaded yet
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/6.jpg not downloaded yet
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/7.jpg not downloaded yet
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/8.jpg not downloaded yet
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/9.jpg not downloaded yet
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813069fc50>
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/1.jpg saved to cache
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%C3%BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mür/eab0568929fe4cd284b2ae19a0e90365/images/large/10.jpg not downloaded yet
2026-03-25 21:46:27 [ayvens.de] INFO: Found listing with ID: 1982564
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982564%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [ayvens.de] INFO: Scrape type for 1982564: 1
2026-03-25 21:46:27 [ayvens.de] INFO: Extracting data for car ID: 1982564
2026-03-25 21:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959feb11-3f0f-5fb7-b952-5e4c4dc79f85 with identifier: 1982564
2026-03-25 21:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85 with scrape type 1
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/1.jpg not downloaded yet
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/2.jpg not downloaded yet
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130687710>
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/6.jpg saved to cache
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69c0d0>
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/5.jpg saved to cache
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2d710>
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/9.jpg saved to cache
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130397c10>
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhu-%252F7a70bfcf465e4e24a12b8ce386ec099d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/10.jpg saved to cache
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be
2026-03-25 21:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87dd26aa-66df-5e81-a34b-2ab0b9dab4be, skipping ID generation
2026-03-25 21:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be with scrape type 1
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87dd26aa-66df-5e81-a34b-2ab0b9dab4be sending to next pipeline
2026-03-25 21:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 87dd26aa-66df-5e81-a34b-2ab0b9dab4be, identifier: 1982560
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132ee2590>
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/7.jpg saved to cache
2026-03-25 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a5190d0>
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/10.jpg saved to cache
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ac02d0>
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/8.jpg saved to cache
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 87dd26aa-66df-5e81-a34b-2ab0b9dab4be with identifier: 1982560
2026-03-25 21:46:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 87dd26aa-66df-5e81-a34b-2ab0b9dab4be with identifier: 1982560
2026-03-25 21:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 87dd26aa-66df-5e81-a34b-2ab0b9dab4be with identifier: 1982560 to the API
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '87dd26aa-66df-5e81-a34b-2ab0b9dab4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 140875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87dd26aa-66df-5e81-a34b-2ab0b9dab4be/87dd26aa-66df-5e81-a34b-2ab0b9dab4be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hu-/7a70bfcf465e4e24a12b8ce386ec099d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia SKODA Octavia Combi 2.0 TDI DSG 4x4 Scout Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'SKODA Octavia Combi 2.0 TDI DSG 4x4 Scout Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982560%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [ayvens.de] INFO: Saving data for 1982560: {'created_time': 1774475188.593066, 'last_price_update_time': 1774475188.593078, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982560') HTTP/1.1" 204 0
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/3.jpg not downloaded yet
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/4.jpg not downloaded yet
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/5.jpg not downloaded yet
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/6.jpg not downloaded yet
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/7.jpg not downloaded yet
2026-03-25 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/8.jpg not downloaded yet
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/9.jpg not downloaded yet
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/10.jpg not downloaded yet
2026-03-25 21:46:28 [ayvens.de] INFO: Found listing with ID: 1982565
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982565%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [ayvens.de] INFO: Scrape type for 1982565: 1
2026-03-25 21:46:28 [ayvens.de] INFO: Extracting data for car ID: 1982565
2026-03-25 21:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1982565
2026-03-25 21:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3bcc8d-1ce2-540f-a98f-adac47df2244 with scrape type 1
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/1.jpg not downloaded yet
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130396850>
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/6.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/2.jpg not downloaded yet
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b43d90>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/2.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130397b90>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/4.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303c1550>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/3.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067ce90>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/7.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f6810>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/5.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303aeed0>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/9.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/3.jpg not downloaded yet
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/4.jpg not downloaded yet
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130656150>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/8.jpg saved to cache
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/5.jpg not downloaded yet
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/6.jpg not downloaded yet
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/7.jpg not downloaded yet
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/8.jpg not downloaded yet
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/9.jpg not downloaded yet
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/10.jpg not downloaded yet
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813060a910>
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/3.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:30 [ayvens.de] INFO: Found listing with ID: 1982566
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982566%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [ayvens.de] INFO: Scrape type for 1982566: 1
2026-03-25 21:46:30 [ayvens.de] INFO: Extracting data for car ID: 1982566
2026-03-25 21:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1982566
2026-03-25 21:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with scrape type 1
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/1.jpg not downloaded yet
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/2.jpg not downloaded yet
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b642a10>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/4.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309f7f50>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/5.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bca710>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/1.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130894d50>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/6.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bc8f50>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/2.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b68a990>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/3.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bcbe50>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/2.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/3.jpg not downloaded yet
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/4.jpg not downloaded yet
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/5.jpg not downloaded yet
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/6.jpg not downloaded yet
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/7.jpg not downloaded yet
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/8.jpg not downloaded yet
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/9.jpg not downloaded yet
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130359010>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/4.jpg saved to cache
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/10.jpg not downloaded yet
2026-03-25 21:46:30 [ayvens.de] INFO: Found listing with ID: 1982567
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982567%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [ayvens.de] INFO: Scrape type for 1982567: 1
2026-03-25 21:46:30 [ayvens.de] INFO: Extracting data for car ID: 1982567
2026-03-25 21:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1982567
2026-03-25 21:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 1
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/1.jpg not downloaded yet
2026-03-25 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/2.jpg not downloaded yet
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6e4110>
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/9.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c36790>
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/10.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81325da310>
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/1.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69cd50>
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/8.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130673210>
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/5.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067f8d0>
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/3.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036e790>
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/2.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/3.jpg not downloaded yet
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/4.jpg not downloaded yet
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c66a10>
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/4.jpg saved to cache
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/5.jpg not downloaded yet
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/6.jpg not downloaded yet
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/7.jpg not downloaded yet
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/8.jpg not downloaded yet
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/9.jpg not downloaded yet
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/10.jpg not downloaded yet
2026-03-25 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:31 [ayvens.de] INFO: Found listing with ID: 1982568
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982568%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [ayvens.de] INFO: Scrape type for 1982568: 1
2026-03-25 21:46:32 [ayvens.de] INFO: Extracting data for car ID: 1982568
2026-03-25 21:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1982568
2026-03-25 21:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with scrape type 1
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/1.jpg not downloaded yet
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130684f50>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/5.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305eb790>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/8.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130615610>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/1.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2d950>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/9.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130387b50>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/10.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/2.jpg not downloaded yet
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/3.jpg not downloaded yet
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b54d0>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/10.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a4a710>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/1.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064bd90>
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/3.jpg saved to cache
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/4.jpg not downloaded yet
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/5.jpg not downloaded yet
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/6.jpg not downloaded yet
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/7.jpg not downloaded yet
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/8.jpg not downloaded yet
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/9.jpg not downloaded yet
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/10.jpg not downloaded yet
2026-03-25 21:46:32 [ayvens.de] INFO: Found listing with ID: 1982569
2026-03-25 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982569%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [ayvens.de] INFO: Scrape type for 1982569: 1
2026-03-25 21:46:33 [ayvens.de] INFO: Extracting data for car ID: 1982569
2026-03-25 21:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1982569
2026-03-25 21:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 1
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/1.jpg not downloaded yet
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064be10>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/9.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/2.jpg not downloaded yet
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b41550>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/5.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064a3d0>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/2.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130895ed0>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/8.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bc8fd0>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/4.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6aead0>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/10.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66bb90>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/2.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308975d0>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/9.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/3.jpg not downloaded yet
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/4.jpg not downloaded yet
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/5.jpg not downloaded yet
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/6.jpg not downloaded yet
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/7.jpg not downloaded yet
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/8.jpg not downloaded yet
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/9.jpg not downloaded yet
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/10.jpg not downloaded yet
2026-03-25 21:46:33 [ayvens.de] INFO: Found listing with ID: 1982570
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982570%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [ayvens.de] INFO: Scrape type for 1982570: 1
2026-03-25 21:46:33 [ayvens.de] INFO: Extracting data for car ID: 1982570
2026-03-25 21:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e20fdce2-501d-5d02-b9b1-c8a17d617a39 with identifier: 1982570
2026-03-25 21:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e20fdce2-501d-5d02-b9b1-c8a17d617a39 with scrape type 1
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/1.jpg not downloaded yet
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/2.jpg not downloaded yet
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130990590>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/4.jpg saved to cache
2026-03-25 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067ebd0>
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/8.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/3.jpg not downloaded yet
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a515350>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/1.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130993e90>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/1.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130695710>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/3.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b677ad0>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/5.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/4.jpg not downloaded yet
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/5.jpg not downloaded yet
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b692cd0>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/10.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130654750>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/2.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/6.jpg not downloaded yet
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/7.jpg not downloaded yet
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/8.jpg not downloaded yet
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/9.jpg not downloaded yet
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/10.jpg not downloaded yet
2026-03-25 21:46:34 [ayvens.de] INFO: Found listing with ID: 1982571
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982571%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [ayvens.de] INFO: Scrape type for 1982571: 1
2026-03-25 21:46:34 [ayvens.de] INFO: Extracting data for car ID: 1982571
2026-03-25 21:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f120d3-15d6-5d34-bc43-018b8f79073d with identifier: 1982571
2026-03-25 21:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f120d3-15d6-5d34-bc43-018b8f79073d with scrape type 1
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/1.jpg not downloaded yet
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/2.jpg not downloaded yet
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064a990>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/9.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2b750>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/4.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6c1710>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/5.jpg saved to cache
2026-03-25 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130662590>
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/8.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/3.jpg not downloaded yet
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/4.jpg not downloaded yet
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067d210>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/3.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307f5fd0>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/2.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308f9c10>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/10.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66bd50>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/1.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/5.jpg not downloaded yet
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/6.jpg not downloaded yet
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/7.jpg not downloaded yet
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/8.jpg not downloaded yet
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/9.jpg not downloaded yet
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/10.jpg not downloaded yet
2026-03-25 21:46:35 [ayvens.de] INFO: Found listing with ID: 1982572
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982572%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [ayvens.de] INFO: Scrape type for 1982572: 1
2026-03-25 21:46:35 [ayvens.de] INFO: Extracting data for car ID: 1982572
2026-03-25 21:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b849310-0edd-5a70-ba9d-35c609925eef with identifier: 1982572
2026-03-25 21:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b849310-0edd-5a70-ba9d-35c609925eef with scrape type 1
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/1.jpg not downloaded yet
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d17950>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/4.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/2.jpg not downloaded yet
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b640b10>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/5.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d16310>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/3.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/3.jpg not downloaded yet
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/4.jpg not downloaded yet
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130953850>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/9.jpg saved to cache
2026-03-25 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132b1a550>
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/3.jpg saved to cache
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a61ad0>
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/2.jpg saved to cache
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bd48d0>
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/10.jpg saved to cache
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67cd50>
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/1.jpg saved to cache
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/5.jpg not downloaded yet
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/6.jpg not downloaded yet
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/7.jpg not downloaded yet
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/8.jpg not downloaded yet
2026-03-25 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/9.jpg not downloaded yet
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bd6f10>
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/8.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a511a10>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/9.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132502250>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/5.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/10.jpg not downloaded yet
2026-03-25 21:46:37 [ayvens.de] INFO: Found listing with ID: 1982573
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982573%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [ayvens.de] INFO: Scrape type for 1982573: 1
2026-03-25 21:46:37 [ayvens.de] INFO: Extracting data for car ID: 1982573
2026-03-25 21:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df6d3d98-9d36-50e1-b747-1136681ee7ad with identifier: 1982573
2026-03-25 21:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df6d3d98-9d36-50e1-b747-1136681ee7ad with scrape type 1
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/1.jpg not downloaded yet
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/2.jpg not downloaded yet
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a510c10>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/4.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b43490>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/6.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093f710>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/3.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b40f90>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/1.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e3ba50>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/2.jpg saved to cache
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/3.jpg not downloaded yet
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/4.jpg not downloaded yet
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/5.jpg not downloaded yet
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/6.jpg not downloaded yet
2026-03-25 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/7.jpg not downloaded yet
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/8.jpg not downloaded yet
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/9.jpg not downloaded yet
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/10.jpg not downloaded yet
2026-03-25 21:46:37 [ayvens.de] INFO: Found listing with ID: 1982574
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982574%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [ayvens.de] INFO: Scrape type for 1982574: 1
2026-03-25 21:46:37 [ayvens.de] INFO: Extracting data for car ID: 1982574
2026-03-25 21:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31f246c2-a774-5fac-95ce-f0b21d44722a with identifier: 1982574
2026-03-25 21:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31f246c2-a774-5fac-95ce-f0b21d44722a with scrape type 1
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/1.jpg not downloaded yet
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b692090>
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/2.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/2.jpg not downloaded yet
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130895890>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/7.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2f3d0>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/4.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a50b150>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/10.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308944d0>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/5.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81325d8f50>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/3.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2db90>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/6.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308f8cd0>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/1.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/3.jpg not downloaded yet
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/4.jpg not downloaded yet
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/5.jpg not downloaded yet
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/6.jpg not downloaded yet
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/7.jpg not downloaded yet
2026-03-25 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/8.jpg not downloaded yet
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/9.jpg not downloaded yet
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/10.jpg not downloaded yet
2026-03-25 21:46:38 [ayvens.de] INFO: Found listing with ID: 1982575
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982575%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [ayvens.de] INFO: Scrape type for 1982575: 1
2026-03-25 21:46:38 [ayvens.de] INFO: Extracting data for car ID: 1982575
2026-03-25 21:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b66dd10-e9c7-5f80-9ef4-96edf4906708 with identifier: 1982575
2026-03-25 21:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708 with scrape type 1
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/1.jpg not downloaded yet
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306145d0>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/10.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303857d0>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/6.jpg saved to cache
2026-03-25 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306a6d90>
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/4.jpg saved to cache
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/2.jpg not downloaded yet
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130616750>
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/8.jpg saved to cache
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305fc910>
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/5.jpg saved to cache
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b625d0>
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/9.jpg saved to cache
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305feb90>
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/9.jpg saved to cache
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/3.jpg not downloaded yet
2026-03-25 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/4.jpg not downloaded yet
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130352990>
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F5c80aa0ed6b441a18394ecc92e85a782%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/7.jpg saved to cache
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b849310-0edd-5a70-ba9d-35c609925eef
2026-03-25 21:46:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b849310-0edd-5a70-ba9d-35c609925eef, skipping ID generation
2026-03-25 21:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b849310-0edd-5a70-ba9d-35c609925eef with scrape type 1
2026-03-25 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b849310-0edd-5a70-ba9d-35c609925eef sending to next pipeline
2026-03-25 21:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3b849310-0edd-5a70-ba9d-35c609925eef, identifier: 1982572
2026-03-25 21:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3b849310-0edd-5a70-ba9d-35c609925eef with identifier: 1982572
2026-03-25 21:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3b849310-0edd-5a70-ba9d-35c609925eef with identifier: 1982572
2026-03-25 21:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3b849310-0edd-5a70-ba9d-35c609925eef with identifier: 1982572 to the API
2026-03-25 21:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '3b849310-0edd-5a70-ba9d-35c609925eef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 207858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b849310-0edd-5a70-ba9d-35c609925eef/3b849310-0edd-5a70-ba9d-35c609925eef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/5c80aa0ed6b441a18394ecc92e85a782/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'ACTIVE Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. ACTIVE Kombi, '
         '5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982572%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [ayvens.de] INFO: Saving data for 1982572: {'created_time': 1774475200.187255, 'last_price_update_time': 1774475200.187265, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982572') HTTP/1.1" 204 0
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/5.jpg not downloaded yet
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/6.jpg not downloaded yet
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130350390>
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/4.jpg saved to cache
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/7.jpg not downloaded yet
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/8.jpg not downloaded yet
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/9.jpg not downloaded yet
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130353850>
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/3.jpg saved to cache
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/10.jpg not downloaded yet
2026-03-25 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:40 [ayvens.de] INFO: Found listing with ID: 1982576
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982576%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [ayvens.de] INFO: Scrape type for 1982576: 1
2026-03-25 21:46:40 [ayvens.de] INFO: Extracting data for car ID: 1982576
2026-03-25 21:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5716b87-1179-5cf2-9bb7-445ca9c6dcbf with identifier: 1982576
2026-03-25 21:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf with scrape type 1
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/1.jpg not downloaded yet
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c67ad0>
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/2.jpg saved to cache
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c36e50>
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/1.jpg saved to cache
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130660c50>
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/2.jpg saved to cache
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130cb9090>
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/1.jpg saved to cache
2026-03-25 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064bc50>
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/10.jpg saved to cache
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130367050>
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/9.jpg saved to cache
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/2.jpg not downloaded yet
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/3.jpg not downloaded yet
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/4.jpg not downloaded yet
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cf210>
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/4.jpg saved to cache
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/5.jpg not downloaded yet
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/6.jpg not downloaded yet
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/7.jpg not downloaded yet
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/8.jpg not downloaded yet
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/9.jpg not downloaded yet
2026-03-25 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/10.jpg not downloaded yet
2026-03-25 21:46:41 [ayvens.de] INFO: Found listing with ID: 1982577
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982577%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [ayvens.de] INFO: Scrape type for 1982577: 1
2026-03-25 21:46:41 [ayvens.de] INFO: Extracting data for car ID: 1982577
2026-03-25 21:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46a43df9-923b-5d9a-88f5-7def564e1bd6 with identifier: 1982577
2026-03-25 21:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46a43df9-923b-5d9a-88f5-7def564e1bd6 with scrape type 1
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/1.jpg not downloaded yet
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f7210>
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/8.jpg saved to cache
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b4f10>
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/3.jpg saved to cache
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cfcd0>
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/7.jpg saved to cache
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/2.jpg not downloaded yet
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/3.jpg not downloaded yet
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a510d0>
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/1.jpg saved to cache
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309d06d0>
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/5.jpg saved to cache
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038c810>
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/6.jpg saved to cache
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064abd0>
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/2.jpg saved to cache
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b661990>
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/3.jpg saved to cache
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/4.jpg not downloaded yet
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/5.jpg not downloaded yet
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/6.jpg not downloaded yet
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/7.jpg not downloaded yet
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/8.jpg not downloaded yet
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/9.jpg not downloaded yet
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/10.jpg not downloaded yet
2026-03-25 21:46:42 [ayvens.de] INFO: Found listing with ID: 1982578
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982578%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [ayvens.de] INFO: Scrape type for 1982578: 1
2026-03-25 21:46:42 [ayvens.de] INFO: Extracting data for car ID: 1982578
2026-03-25 21:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9a436c7-26d2-5b81-b01b-a3415072d28f with identifier: 1982578
2026-03-25 21:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9a436c7-26d2-5b81-b01b-a3415072d28f with scrape type 1
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/1.jpg not downloaded yet
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130603950>
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/4.jpg saved to cache
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305e95d0>
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/9.jpg saved to cache
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/2.jpg not downloaded yet
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a5101d0>
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/6.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309f51d0>
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/7.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e3b910>
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/5.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/3.jpg not downloaded yet
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/4.jpg not downloaded yet
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132217610>
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/8.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306dadd0>
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/10.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a82710>
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/2.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/5.jpg not downloaded yet
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/6.jpg not downloaded yet
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/7.jpg not downloaded yet
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/8.jpg not downloaded yet
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/9.jpg not downloaded yet
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/10.jpg not downloaded yet
2026-03-25 21:46:43 [ayvens.de] INFO: Found listing with ID: 1982579
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982579%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [ayvens.de] INFO: Scrape type for 1982579: 1
2026-03-25 21:46:43 [ayvens.de] INFO: Extracting data for car ID: 1982579
2026-03-25 21:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d with identifier: 1982579
2026-03-25 21:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d with scrape type 1
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/1.jpg not downloaded yet
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093c4d0>
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/3.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/2.jpg not downloaded yet
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d15fd0>
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fa154dd2991c14bd894bfcefc8d2c7b2d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/10.jpg saved to cache
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708
2026-03-25 21:46:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b66dd10-e9c7-5f80-9ef4-96edf4906708, skipping ID generation
2026-03-25 21:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708 with scrape type 1
2026-03-25 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b66dd10-e9c7-5f80-9ef4-96edf4906708 sending to next pipeline
2026-03-25 21:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 5b66dd10-e9c7-5f80-9ef4-96edf4906708, identifier: 1982575
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81329b0d50>
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/4.jpg saved to cache
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813097fa50>
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/2.jpg saved to cache
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305fe6d0>
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/1.jpg saved to cache
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b66b7d0>
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/5.jpg saved to cache
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/3.jpg not downloaded yet
2026-03-25 21:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 5b66dd10-e9c7-5f80-9ef4-96edf4906708 with identifier: 1982575
2026-03-25 21:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 5b66dd10-e9c7-5f80-9ef4-96edf4906708 with identifier: 1982575
2026-03-25 21:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 5b66dd10-e9c7-5f80-9ef4-96edf4906708 with identifier: 1982575 to the API
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5b66dd10-e9c7-5f80-9ef4-96edf4906708',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 119501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b66dd10-e9c7-5f80-9ef4-96edf4906708/5b66dd10-e9c7-5f80-9ef4-96edf4906708_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/a154dd2991c14bd894bfcefc8d2c7b2d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Spirit Kombi, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Spirit Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982575%27 HTTP/1.1" 200 None
2026-03-25 21:46:44 [ayvens.de] INFO: Saving data for 1982575: {'created_time': 1774475204.810623, 'last_price_update_time': 1774475204.810633, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982575') HTTP/1.1" 204 0
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/4.jpg not downloaded yet
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ccc390>
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/9.jpg saved to cache
2026-03-25 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6cbd50>
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/6.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/5.jpg not downloaded yet
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/6.jpg not downloaded yet
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/7.jpg not downloaded yet
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/8.jpg not downloaded yet
2026-03-25 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/9.jpg not downloaded yet
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/10.jpg not downloaded yet
2026-03-25 21:46:45 [ayvens.de] INFO: Found listing with ID: 1982580
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982580%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [ayvens.de] INFO: Scrape type for 1982580: 1
2026-03-25 21:46:45 [ayvens.de] INFO: Extracting data for car ID: 1982580
2026-03-25 21:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fcc5e33-1566-583f-b24f-7b657399d555 with identifier: 1982580
2026-03-25 21:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fcc5e33-1566-583f-b24f-7b657399d555 with scrape type 1
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/1.jpg not downloaded yet
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/2.jpg not downloaded yet
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6e7a50>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/3.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130377750>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/4.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b661d10>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/5.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b640150>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/1.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306840d0>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/1.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303c1650>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/2.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/3.jpg not downloaded yet
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2b510>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/9.jpg saved to cache
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/4.jpg not downloaded yet
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/5.jpg not downloaded yet
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307f6150>
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/10.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/6.jpg not downloaded yet
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/7.jpg not downloaded yet
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/8.jpg not downloaded yet
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/9.jpg not downloaded yet
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/10.jpg not downloaded yet
2026-03-25 21:46:46 [ayvens.de] INFO: Found listing with ID: 1982581
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982581%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [ayvens.de] INFO: Scrape type for 1982581: 1
2026-03-25 21:46:46 [ayvens.de] INFO: Extracting data for car ID: 1982581
2026-03-25 21:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4 with identifier: 1982581
2026-03-25 21:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4 with scrape type 1
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/1.jpg not downloaded yet
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/2.jpg not downloaded yet
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/3.jpg not downloaded yet
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303c18d0>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/8.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303773d0>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/4.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/4.jpg not downloaded yet
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d15b90>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/3.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6effd0>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/5.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132502250>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/3.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/5.jpg not downloaded yet
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6ed7d0>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/7.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813034b990>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/2.jpg saved to cache
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/6.jpg not downloaded yet
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c37910>
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/6.jpg saved to cache
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/7.jpg not downloaded yet
2026-03-25 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/8.jpg not downloaded yet
2026-03-25 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cc750>
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/4.jpg saved to cache
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/9.jpg not downloaded yet
2026-03-25 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/10.jpg not downloaded yet
2026-03-25 21:46:47 [ayvens.de] INFO: Found listing with ID: 1982582
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982582%27 HTTP/1.1" 200 None
2026-03-25 21:46:47 [ayvens.de] INFO: Scrape type for 1982582: 1
2026-03-25 21:46:47 [ayvens.de] INFO: Extracting data for car ID: 1982582
2026-03-25 21:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83aa277d-a39d-5690-9575-e2936bdc4d5d with identifier: 1982582
2026-03-25 21:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83aa277d-a39d-5690-9575-e2936bdc4d5d with scrape type 1
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/1.jpg not downloaded yet
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2d550>
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/5.jpg saved to cache
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309d3cd0>
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/1.jpg saved to cache
2026-03-25 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d14210>
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/10.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/2.jpg not downloaded yet
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132503b10>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/9.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130601a10>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/3.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130abbf50>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/6.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/3.jpg not downloaded yet
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/4.jpg not downloaded yet
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309f5310>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/2.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/5.jpg not downloaded yet
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/6.jpg not downloaded yet
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/7.jpg not downloaded yet
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/8.jpg not downloaded yet
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/9.jpg not downloaded yet
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/10.jpg not downloaded yet
2026-03-25 21:46:48 [ayvens.de] INFO: Found listing with ID: 1982583
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982583%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [ayvens.de] INFO: Scrape type for 1982583: 1
2026-03-25 21:46:48 [ayvens.de] INFO: Extracting data for car ID: 1982583
2026-03-25 21:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c61ac1c-3f25-5c7c-a876-68c3268012d3 with identifier: 1982583
2026-03-25 21:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3 with scrape type 1
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/1.jpg not downloaded yet
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309f5f10>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/6.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/2.jpg not downloaded yet
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6e5710>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/5.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813288ba90>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/4.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130cce610>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/7.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132503c50>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/1.jpg saved to cache
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/3.jpg not downloaded yet
2026-03-25 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/4.jpg not downloaded yet
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d16f50>
2026-03-25 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/3.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813061cd50>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/4.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/5.jpg not downloaded yet
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/6.jpg not downloaded yet
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306153d0>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/2.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/7.jpg not downloaded yet
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/8.jpg not downloaded yet
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/9.jpg not downloaded yet
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132504bd0>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/5.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130353290>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/1.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a516b10>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/7.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/10.jpg not downloaded yet
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [ayvens.de] INFO: Found listing with ID: 1982584
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982584%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [ayvens.de] INFO: Scrape type for 1982584: 1
2026-03-25 21:46:49 [ayvens.de] INFO: Extracting data for car ID: 1982584
2026-03-25 21:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e721231-6575-56f4-9bb0-72b0bb4c1396 with identifier: 1982584
2026-03-25 21:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e721231-6575-56f4-9bb0-72b0bb4c1396 with scrape type 1
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/1.jpg not downloaded yet
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130352950>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/10.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813065a850>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/8.jpg saved to cache
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/2.jpg not downloaded yet
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/3.jpg not downloaded yet
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/4.jpg not downloaded yet
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ccd50>
2026-03-25 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/6.jpg saved to cache
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a503790>
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/9.jpg saved to cache
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/5.jpg not downloaded yet
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/6.jpg not downloaded yet
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e9d050>
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/4.jpg saved to cache
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130896050>
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/2.jpg saved to cache
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132217110>
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/5.jpg saved to cache
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/7.jpg not downloaded yet
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/8.jpg not downloaded yet
2026-03-25 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/9.jpg not downloaded yet
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c9f010>
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F76fbc88b666541d092b5a42bf816fd4b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/10.jpg saved to cache
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4
2026-03-25 21:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4, skipping ID generation
2026-03-25 21:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4 with scrape type 1
2026-03-25 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4 sending to next pipeline
2026-03-25 21:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4, identifier: 1982581
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813069ff10>
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/3.jpg saved to cache
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d6de90>
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/1.jpg saved to cache
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4 with identifier: 1982581
2026-03-25 21:46:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4 with identifier: 1982581
2026-03-25 21:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4 with identifier: 1982581 to the API
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model 3',
 'odometer': 52068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4/39b4adcb-1c7b-5aa7-a138-34ed7ce7ade4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/76fbc88b666541d092b5a42bf816fd4b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model 3 TESLA Model 3 RWD Hinterradantrieb Limousine, '
          '4-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model 3 RWD Hinterradantrieb Limousine, 4-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982581%27 HTTP/1.1" 200 None
2026-03-25 21:46:51 [ayvens.de] INFO: Saving data for 1982581: {'created_time': 1774475211.702085, 'last_price_update_time': 1774475211.702095, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982581') HTTP/1.1" 204 0
2026-03-25 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/10.jpg not downloaded yet
2026-03-25 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:51 [ayvens.de] INFO: Found listing with ID: 1982585
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982585%27 HTTP/1.1" 200 None
2026-03-25 21:46:51 [ayvens.de] INFO: Scrape type for 1982585: 1
2026-03-25 21:46:51 [ayvens.de] INFO: Extracting data for car ID: 1982585
2026-03-25 21:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e with identifier: 1982585
2026-03-25 21:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e with scrape type 1
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/1.jpg not downloaded yet
2026-03-25 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6691d0>
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/6.jpg saved to cache
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/2.jpg not downloaded yet
2026-03-25 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/3.jpg not downloaded yet
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130976850>
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/3.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132507e50>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/9.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/4.jpg not downloaded yet
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d15d50>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/5.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/5.jpg not downloaded yet
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d17650>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/4.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a51a4d0>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/6.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303c09d0>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/2.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308ace90>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/1.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/6.jpg not downloaded yet
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/7.jpg not downloaded yet
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/8.jpg not downloaded yet
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/9.jpg not downloaded yet
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/10.jpg not downloaded yet
2026-03-25 21:46:52 [ayvens.de] INFO: Found listing with ID: 1982586
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982586%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [ayvens.de] INFO: Scrape type for 1982586: 1
2026-03-25 21:46:52 [ayvens.de] INFO: Extracting data for car ID: 1982586
2026-03-25 21:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c491011-776b-5fe5-aa26-4f5c349b9231 with identifier: 1982586
2026-03-25 21:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c491011-776b-5fe5-aa26-4f5c349b9231 with scrape type 1
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/1.jpg not downloaded yet
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/2.jpg not downloaded yet
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a51a450>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/9.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130975cd0>
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/8.jpg saved to cache
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/3.jpg not downloaded yet
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/4.jpg not downloaded yet
2026-03-25 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/5.jpg not downloaded yet
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c67a50>
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/3.jpg saved to cache
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a81910>
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/4.jpg saved to cache
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309d0190>
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/2.jpg saved to cache
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130394c90>
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/1.jpg saved to cache
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c67cd0>
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/10.jpg saved to cache
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308c4d10>
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4cc9c433fc9f4b23ae64003ef281e89a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/7.jpg saved to cache
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3
2026-03-25 21:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c61ac1c-3f25-5c7c-a876-68c3268012d3, skipping ID generation
2026-03-25 21:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3 with scrape type 1
2026-03-25 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c61ac1c-3f25-5c7c-a876-68c3268012d3 sending to next pipeline
2026-03-25 21:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 7c61ac1c-3f25-5c7c-a876-68c3268012d3, identifier: 1982583
2026-03-25 21:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 7c61ac1c-3f25-5c7c-a876-68c3268012d3 with identifier: 1982583
2026-03-25 21:46:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 7c61ac1c-3f25-5c7c-a876-68c3268012d3 with identifier: 1982583
2026-03-25 21:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 7c61ac1c-3f25-5c7c-a876-68c3268012d3 with identifier: 1982583 to the API
2026-03-25 21:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '7c61ac1c-3f25-5c7c-a876-68c3268012d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 15904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c61ac1c-3f25-5c7c-a876-68c3268012d3/7c61ac1c-3f25-5c7c-a876-68c3268012d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4cc9c433fc9f4b23ae64003ef281e89a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982583%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [ayvens.de] INFO: Saving data for 1982583: {'created_time': 1774475214.130377, 'last_price_update_time': 1774475214.130386, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982583') HTTP/1.1" 204 0
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/6.jpg not downloaded yet
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813220c710>
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/9.jpg saved to cache
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/7.jpg not downloaded yet
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/8.jpg not downloaded yet
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/9.jpg not downloaded yet
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b642c10>
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/8.jpg saved to cache
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/10.jpg not downloaded yet
2026-03-25 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:54 [ayvens.de] INFO: Found listing with ID: 1982504
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982504%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [ayvens.de] INFO: Scrape type for 1982504: 1
2026-03-25 21:46:54 [ayvens.de] INFO: Extracting data for car ID: 1982504
2026-03-25 21:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1982504
2026-03-25 21:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a18c085-c262-58bf-86cf-e9e44262cbe8 with scrape type 1
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/1.jpg not downloaded yet
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c65e90>
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/7.jpg saved to cache
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309d3c90>
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/10.jpg saved to cache
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ccf50>
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/6.jpg saved to cache
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cf650>
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/2.jpg saved to cache
2026-03-25 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/2.jpg not downloaded yet
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/3.jpg not downloaded yet
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/4.jpg not downloaded yet
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308ae950>
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/1.jpg saved to cache
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6cbc10>
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F89bc7960cfd24765802fb142c3d9d50e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/5.jpg saved to cache
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e721231-6575-56f4-9bb0-72b0bb4c1396
2026-03-25 21:46:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e721231-6575-56f4-9bb0-72b0bb4c1396, skipping ID generation
2026-03-25 21:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e721231-6575-56f4-9bb0-72b0bb4c1396 with scrape type 1
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e721231-6575-56f4-9bb0-72b0bb4c1396 sending to next pipeline
2026-03-25 21:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2e721231-6575-56f4-9bb0-72b0bb4c1396, identifier: 1982584
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130350550>
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/5.jpg saved to cache
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2e721231-6575-56f4-9bb0-72b0bb4c1396 with identifier: 1982584
2026-03-25 21:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2e721231-6575-56f4-9bb0-72b0bb4c1396 with identifier: 1982584
2026-03-25 21:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2e721231-6575-56f4-9bb0-72b0bb4c1396 with identifier: 1982584 to the API
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '2e721231-6575-56f4-9bb0-72b0bb4c1396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 29096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e721231-6575-56f4-9bb0-72b0bb4c1396/2e721231-6575-56f4-9bb0-72b0bb4c1396_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/89bc7960cfd24765802fb142c3d9d50e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982584%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [ayvens.de] INFO: Saving data for 1982584: {'created_time': 1774475215.819845, 'last_price_update_time': 1774475215.819855, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982584') HTTP/1.1" 204 0
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/5.jpg not downloaded yet
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/6.jpg not downloaded yet
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/7.jpg not downloaded yet
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/8.jpg not downloaded yet
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/9.jpg not downloaded yet
2026-03-25 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/10.jpg not downloaded yet
2026-03-25 21:46:55 [ayvens.de] INFO: Found listing with ID: 1982505
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982505%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [ayvens.de] INFO: Scrape type for 1982505: 1
2026-03-25 21:46:55 [ayvens.de] INFO: Extracting data for car ID: 1982505
2026-03-25 21:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1982505
2026-03-25 21:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/1.jpg not downloaded yet
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/2.jpg not downloaded yet
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c65f50>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/8.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d68d90>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/7.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6c9290>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/9.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064abd0>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/4.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/3.jpg not downloaded yet
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130abb290>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/6.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6553d0>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/10.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a51a850>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/3.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/4.jpg not downloaded yet
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6e4d50>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/6.jpg saved to cache
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/5.jpg not downloaded yet
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/6.jpg not downloaded yet
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/7.jpg not downloaded yet
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/8.jpg not downloaded yet
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/9.jpg not downloaded yet
2026-03-25 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/10.jpg not downloaded yet
2026-03-25 21:46:56 [ayvens.de] INFO: Found listing with ID: 1982506
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982506%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [ayvens.de] INFO: Scrape type for 1982506: 1
2026-03-25 21:46:56 [ayvens.de] INFO: Extracting data for car ID: 1982506
2026-03-25 21:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1982506
2026-03-25 21:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f595488c-ff5d-50c2-9245-9e43f0df663e with scrape type 1
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/1.jpg not downloaded yet
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/2.jpg not downloaded yet
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e9dc90>
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/10.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309f6a10>
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/4.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/3.jpg not downloaded yet
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813099b6d0>
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/5.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81324d6090>
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/7.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038d650>
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/8.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/4.jpg not downloaded yet
2026-03-25 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/5.jpg not downloaded yet
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130673d10>
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/2.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69da10>
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/1.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b662210>
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Ffecff9b0e1214806b7a922df684f2484%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/9.jpg saved to cache
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c491011-776b-5fe5-aa26-4f5c349b9231
2026-03-25 21:46:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c491011-776b-5fe5-aa26-4f5c349b9231, skipping ID generation
2026-03-25 21:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c491011-776b-5fe5-aa26-4f5c349b9231 with scrape type 1
2026-03-25 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c491011-776b-5fe5-aa26-4f5c349b9231 sending to next pipeline
2026-03-25 21:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1c491011-776b-5fe5-aa26-4f5c349b9231, identifier: 1982586
2026-03-25 21:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1c491011-776b-5fe5-aa26-4f5c349b9231 with identifier: 1982586
2026-03-25 21:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1c491011-776b-5fe5-aa26-4f5c349b9231 with identifier: 1982586
2026-03-25 21:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1c491011-776b-5fe5-aa26-4f5c349b9231 with identifier: 1982586 to the API
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '1c491011-776b-5fe5-aa26-4f5c349b9231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 39513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c491011-776b-5fe5-aa26-4f5c349b9231/1c491011-776b-5fe5-aa26-4f5c349b9231_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/fecff9b0e1214806b7a922df684f2484/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982586%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [ayvens.de] INFO: Saving data for 1982586: {'created_time': 1774475218.352699, 'last_price_update_time': 1774475218.35271, 'auction_closing_time': 1774533600.0}
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982586') HTTP/1.1" 204 0
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/6.jpg not downloaded yet
2026-03-25 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/7.jpg not downloaded yet
2026-03-25 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306712d0>
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/4.jpg saved to cache
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/8.jpg not downloaded yet
2026-03-25 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/9.jpg not downloaded yet
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a15f10>
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/5.jpg saved to cache
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b663890>
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/2.jpg saved to cache
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/10.jpg not downloaded yet
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ccd690>
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/1.jpg saved to cache
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a36290>
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/3.jpg saved to cache
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:58 [ayvens.de] INFO: Found listing with ID: 1982507
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982507%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [ayvens.de] INFO: Scrape type for 1982507: 1
2026-03-25 21:46:58 [ayvens.de] INFO: Extracting data for car ID: 1982507
2026-03-25 21:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1982507
2026-03-25 21:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/1.jpg not downloaded yet
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e39d50>
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/6.jpg saved to cache
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a51bc50>
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/3.jpg saved to cache
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67ce50>
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/7.jpg saved to cache
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/2.jpg not downloaded yet
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/3.jpg not downloaded yet
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/4.jpg not downloaded yet
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/5.jpg not downloaded yet
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/6.jpg not downloaded yet
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/7.jpg not downloaded yet
2026-03-25 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/8.jpg not downloaded yet
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130abb9d0>
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/6.jpg saved to cache
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/9.jpg not downloaded yet
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/10.jpg not downloaded yet
2026-03-25 21:46:59 [ayvens.de] INFO: Found listing with ID: 1982508
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982508%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [ayvens.de] INFO: Scrape type for 1982508: 1
2026-03-25 21:46:59 [ayvens.de] INFO: Extracting data for car ID: 1982508
2026-03-25 21:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1982508
2026-03-25 21:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/1.jpg not downloaded yet
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130cce410>
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/5.jpg saved to cache
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306eab90>
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/4.jpg saved to cache
2026-03-25 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303ad9d0>
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/2.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036fa50>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/1.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b67cd50>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/7.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308f9d50>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/2.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813036fa90>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/3.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/2.jpg not downloaded yet
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/3.jpg not downloaded yet
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/4.jpg not downloaded yet
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/5.jpg not downloaded yet
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/6.jpg not downloaded yet
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/7.jpg not downloaded yet
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/8.jpg not downloaded yet
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305fd290>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/4.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/9.jpg not downloaded yet
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/10.jpg not downloaded yet
2026-03-25 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:00 [ayvens.de] INFO: Found listing with ID: 1982509
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982509%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [ayvens.de] INFO: Scrape type for 1982509: 1
2026-03-25 21:47:00 [ayvens.de] INFO: Extracting data for car ID: 1982509
2026-03-25 21:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1982509
2026-03-25 21:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3bfb67-68c7-552f-ad4b-c4775a03e201 with scrape type 1
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/1.jpg not downloaded yet
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130991c50>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/6.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130cba4d0>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/1.jpg saved to cache
2026-03-25 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303ace50>
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/10.jpg saved to cache
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6e51d0>
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/5.jpg saved to cache
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309ad350>
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/7.jpg saved to cache
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813066b250>
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/8.jpg saved to cache
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a517350>
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/9.jpg saved to cache
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/2.jpg not downloaded yet
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/3.jpg not downloaded yet
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308dde50>
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/1.jpg saved to cache
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/4.jpg not downloaded yet
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/5.jpg not downloaded yet
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/6.jpg not downloaded yet
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/7.jpg not downloaded yet
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/8.jpg not downloaded yet
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/9.jpg not downloaded yet
2026-03-25 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/10.jpg not downloaded yet
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ace90>
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/2.jpg saved to cache
2026-03-25 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:01 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cf490>
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/4.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a51bd0>
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/2.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b63f710>
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/10.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a61450>
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/3.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132a1ad50>
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/10.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308fabd0>
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/1.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307f4490>
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/9.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d15e50>
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/8.jpg saved to cache
2026-03-25 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a2ab50>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/3.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d4ccd0>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/6.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130acb110>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/4.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d4cd50>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/7.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132274f50>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/9.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132266710>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/1.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130609590>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/10.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d4f610>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/5.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81326f9890>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/3.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306daa10>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/8.jpg saved to cache
2026-03-25 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130cbbad0>
2026-03-25 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/4.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c669d0>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/8.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130387510>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/2.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813061c6d0>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/7.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c65f50>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/10.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130895210>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/9.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d58a10>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/5.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ea950>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/6.jpg saved to cache
2026-03-25 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b640850>
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252F3ad3dff3752d429696cc08ee125000eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/7.jpg saved to cache
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-25 21:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb3bfb67-68c7-552f-ad4b-c4775a03e201, skipping ID generation
2026-03-25 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3bfb67-68c7-552f-ad4b-c4775a03e201 with scrape type 1
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb3bfb67-68c7-552f-ad4b-c4775a03e201 sending to next pipeline
2026-03-25 21:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cb3bfb67-68c7-552f-ad4b-c4775a03e201, identifier: 1982509
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d11b90>
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F0eb728333ef4498e925ec6f727bba1d2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/6.jpg saved to cache
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-25 21:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11342670-1c07-51fa-9975-7777a82b441e, skipping ID generation
2026-03-25 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11342670-1c07-51fa-9975-7777a82b441e sending to next pipeline
2026-03-25 21:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 11342670-1c07-51fa-9975-7777a82b441e, identifier: 1982508
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b641b50>
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252Fe132989676e8462299bff508734a4ebf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/9.jpg saved to cache
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-25 21:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f595488c-ff5d-50c2-9245-9e43f0df663e, skipping ID generation
2026-03-25 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f595488c-ff5d-50c2-9245-9e43f0df663e with scrape type 1
2026-03-25 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f595488c-ff5d-50c2-9245-9e43f0df663e sending to next pipeline
2026-03-25 21:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f595488c-ff5d-50c2-9245-9e43f0df663e, identifier: 1982506
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b95e10>
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Fb257e33dc3bd4bffa21b15d4199bf123%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/5.jpg saved to cache
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-25 21:47:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e731dd25-76e8-5724-931b-52a262f9cb61, skipping ID generation
2026-03-25 21:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e731dd25-76e8-5724-931b-52a262f9cb61 sending to next pipeline
2026-03-25 21:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e731dd25-76e8-5724-931b-52a262f9cb61, identifier: 1982507
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132267350>
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/9.jpg saved to cache
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81310d85d0>
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/10.jpg saved to cache
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e07a90>
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252Fa41068f6554b41a3a64b42e8b916a255%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/8.jpg saved to cache
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-25 21:47:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e43e99e6-fda1-5f2a-bce1-1804c47092dd, skipping ID generation
2026-03-25 21:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e43e99e6-fda1-5f2a-bce1-1804c47092dd sending to next pipeline
2026-03-25 21:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e43e99e6-fda1-5f2a-bce1-1804c47092dd, identifier: 1982505
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306a7f50>
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/9.jpg saved to cache
2026-03-25 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1982509
2026-03-25 21:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1982509
2026-03-25 21:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1982509 to the API
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cb3bfb67-68c7-552f-ad4b-c4775a03e201',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41016',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 60809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/3ad3dff3752d429696cc08ee125000eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982509%27 HTTP/1.1" 200 None
2026-03-25 21:47:07 [ayvens.de] INFO: Saving data for 1982509: {'created_time': 1774475227.035848, 'last_price_update_time': 1774475227.035858, 'auction_closing_time': 1774530000.0}
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982509') HTTP/1.1" 204 0
2026-03-25 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1982508
2026-03-25 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1982508
2026-03-25 21:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1982508 to the API
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '11342670-1c07-51fa-9975-7777a82b441e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41016',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Megane',
 'odometer': 109877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/0eb728333ef4498e925ec6f727bba1d2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Megane RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS '
          'Kombi, 5-türig, Automatik, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS Kombi, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982508%27 HTTP/1.1" 200 None
2026-03-25 21:47:07 [ayvens.de] INFO: Saving data for 1982508: {'created_time': 1774475227.391245, 'last_price_update_time': 1774475227.391255, 'auction_closing_time': 1774530000.0}
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982508') HTTP/1.1" 204 0
2026-03-25 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1982506
2026-03-25 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1982506
2026-03-25 21:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1982506 to the API
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Frost',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f595488c-ff5d-50c2-9245-9e43f0df663e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41016',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 58995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/e132989676e8462299bff508734a4ebf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus 1.5 EcoBlue Start-Stopp-System TREND '
          'Limousine, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Focus 1.5 EcoBlue Start-Stopp-System TREND Limousine, 5-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982506%27 HTTP/1.1" 200 None
2026-03-25 21:47:07 [ayvens.de] INFO: Saving data for 1982506: {'created_time': 1774475227.770267, 'last_price_update_time': 1774475227.770278, 'auction_closing_time': 1774530000.0}
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982506') HTTP/1.1" 204 0
2026-03-25 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1982507
2026-03-25 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1982507
2026-03-25 21:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1982507 to the API
2026-03-25 21:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e731dd25-76e8-5724-931b-52a262f9cb61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41016',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 80099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/b257e33dc3bd4bffa21b15d4199bf123/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982507%27 HTTP/1.1" 200 None
2026-03-25 21:47:08 [ayvens.de] INFO: Saving data for 1982507: {'created_time': 1774475228.1342, 'last_price_update_time': 1774475228.13421, 'auction_closing_time': 1774530000.0}
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982507') HTTP/1.1" 204 0
2026-03-25 21:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1982505
2026-03-25 21:47:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1982505
2026-03-25 21:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1982505 to the API
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Polarwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e43e99e6-fda1-5f2a-bce1-1804c47092dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41016',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 48484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/a41068f6554b41a3a64b42e8b916a255/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG '
          'Line Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG Line Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982505%27 HTTP/1.1" 200 None
2026-03-25 21:47:08 [ayvens.de] INFO: Saving data for 1982505: {'created_time': 1774475228.511894, 'last_price_update_time': 1774475228.511905, 'auction_closing_time': 1774530000.0}
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982505') HTTP/1.1" 204 0
2026-03-25 21:47:08 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at -4 pages/min), scraped 26 items (at 17 items/min)
2026-03-25 21:47:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b70610>
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/8.jpg saved to cache
2026-03-25 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a615d0>
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F2aa15030af174d6ca4f01fe2caf4fa49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/3.jpg saved to cache
2026-03-25 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e
2026-03-25 21:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e, skipping ID generation
2026-03-25 21:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e with scrape type 1
2026-03-25 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e sending to next pipeline
2026-03-25 21:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e, identifier: 1982585
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b42510>
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Fa42c15ccb7814eccababd68c318256e8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/8.jpg saved to cache
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-25 21:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a18c085-c262-58bf-86cf-e9e44262cbe8, skipping ID generation
2026-03-25 21:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a18c085-c262-58bf-86cf-e9e44262cbe8 with scrape type 1
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a18c085-c262-58bf-86cf-e9e44262cbe8 sending to next pipeline
2026-03-25 21:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2a18c085-c262-58bf-86cf-e9e44262cbe8, identifier: 1982504
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130654450>
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbn-%252Fed2174b838424e9dafd1f824dc40f6e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/8.jpg saved to cache
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fcc5e33-1566-583f-b24f-7b657399d555
2026-03-25 21:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fcc5e33-1566-583f-b24f-7b657399d555, skipping ID generation
2026-03-25 21:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fcc5e33-1566-583f-b24f-7b657399d555 with scrape type 1
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fcc5e33-1566-583f-b24f-7b657399d555 sending to next pipeline
2026-03-25 21:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0fcc5e33-1566-583f-b24f-7b657399d555, identifier: 1982580
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a627d0>
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/10.jpg saved to cache
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132220490>
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/10.jpg saved to cache
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132217b90>
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/9.jpg saved to cache
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130358f90>
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F5d271fc5f17c4077b29757fccf373c75%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/7.jpg saved to cache
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83aa277d-a39d-5690-9575-e2936bdc4d5d
2026-03-25 21:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83aa277d-a39d-5690-9575-e2936bdc4d5d, skipping ID generation
2026-03-25 21:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83aa277d-a39d-5690-9575-e2936bdc4d5d with scrape type 1
2026-03-25 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83aa277d-a39d-5690-9575-e2936bdc4d5d sending to next pipeline
2026-03-25 21:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 83aa277d-a39d-5690-9575-e2936bdc4d5d, identifier: 1982582
2026-03-25 21:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e with identifier: 1982585
2026-03-25 21:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e with identifier: 1982585
2026-03-25 21:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e with identifier: 1982585 to the API
2026-03-25 21:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 24162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e/df2d3ff0-a9be-5a69-8a0b-d84e56c1c08e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/2aa15030af174d6ca4f01fe2caf4fa49/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982585%27 HTTP/1.1" 200 None
2026-03-25 21:47:10 [ayvens.de] INFO: Saving data for 1982585: {'created_time': 1774475230.20496, 'last_price_update_time': 1774475230.20497, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982585') HTTP/1.1" 204 0
2026-03-25 21:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1982504
2026-03-25 21:47:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1982504
2026-03-25 21:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1982504 to the API
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Alpinwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2a18c085-c262-58bf-86cf-e9e44262cbe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41016',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 108394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/a42c15ccb7814eccababd68c318256e8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 BMW X3 xDrive30e Aut. M Sport Geschlossen, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW X3 xDrive30e Aut. M Sport Geschlossen, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982504%27 HTTP/1.1" 200 None
2026-03-25 21:47:10 [ayvens.de] INFO: Saving data for 1982504: {'created_time': 1774475230.545347, 'last_price_update_time': 1774475230.545357, 'auction_closing_time': 1774530000.0}
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982504') HTTP/1.1" 204 0
2026-03-25 21:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0fcc5e33-1566-583f-b24f-7b657399d555 with identifier: 1982580
2026-03-25 21:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0fcc5e33-1566-583f-b24f-7b657399d555 with identifier: 1982580
2026-03-25 21:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0fcc5e33-1566-583f-b24f-7b657399d555 with identifier: 1982580 to the API
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '0fcc5e33-1566-583f-b24f-7b657399d555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 30582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fcc5e33-1566-583f-b24f-7b657399d555/0fcc5e33-1566-583f-b24f-7b657399d555_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bn-/ed2174b838424e9dafd1f824dc40f6e7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Dual Motor 78kWh Limousine, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Dual Motor 78kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982580%27 HTTP/1.1" 200 None
2026-03-25 21:47:10 [ayvens.de] INFO: Saving data for 1982580: {'created_time': 1774475230.945401, 'last_price_update_time': 1774475230.945416, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982580') HTTP/1.1" 204 0
2026-03-25 21:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 83aa277d-a39d-5690-9575-e2936bdc4d5d with identifier: 1982582
2026-03-25 21:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 83aa277d-a39d-5690-9575-e2936bdc4d5d with identifier: 1982582
2026-03-25 21:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 83aa277d-a39d-5690-9575-e2936bdc4d5d with identifier: 1982582 to the API
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '83aa277d-a39d-5690-9575-e2936bdc4d5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 48271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83aa277d-a39d-5690-9575-e2936bdc4d5d/83aa277d-a39d-5690-9575-e2936bdc4d5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/5d271fc5f17c4077b29757fccf373c75/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982582%27 HTTP/1.1" 200 None
2026-03-25 21:47:11 [ayvens.de] INFO: Saving data for 1982582: {'created_time': 1774475231.317398, 'last_price_update_time': 1774475231.317409, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982582') HTTP/1.1" 204 0
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813220c8d0>
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/8.jpg saved to cache
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d38990>
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252Fc3d5fab69ba2409fbf7223aaf3e8e770%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/7.jpg saved to cache
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d
2026-03-25 21:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d, skipping ID generation
2026-03-25 21:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d with scrape type 1
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d sending to next pipeline
2026-03-25 21:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d, identifier: 1982579
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81309603d0>
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/8.jpg saved to cache
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130350c50>
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/8.jpg saved to cache
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69d1d0>
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/10.jpg saved to cache
2026-03-25 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b72690>
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/9.jpg saved to cache
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813069da50>
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-d%252Ffa5ce58590734e199eaf8100aa135eec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/6.jpg saved to cache
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46a43df9-923b-5d9a-88f5-7def564e1bd6
2026-03-25 21:47:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46a43df9-923b-5d9a-88f5-7def564e1bd6, skipping ID generation
2026-03-25 21:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46a43df9-923b-5d9a-88f5-7def564e1bd6 with scrape type 1
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46a43df9-923b-5d9a-88f5-7def564e1bd6 sending to next pipeline
2026-03-25 21:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 46a43df9-923b-5d9a-88f5-7def564e1bd6, identifier: 1982577
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130fb1d50>
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F3743517fe6d64bbabdc5381c2cbbdd45%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/7.jpg saved to cache
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9a436c7-26d2-5b81-b01b-a3415072d28f
2026-03-25 21:47:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9a436c7-26d2-5b81-b01b-a3415072d28f, skipping ID generation
2026-03-25 21:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9a436c7-26d2-5b81-b01b-a3415072d28f with scrape type 1
2026-03-25 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9a436c7-26d2-5b81-b01b-a3415072d28f sending to next pipeline
2026-03-25 21:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e9a436c7-26d2-5b81-b01b-a3415072d28f, identifier: 1982578
2026-03-25 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d with identifier: 1982579
2026-03-25 21:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d with identifier: 1982579
2026-03-25 21:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d with identifier: 1982579 to the API
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'Leaf',
 'odometer': 47192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d/f03f7bf0-1cdf-5ea7-9bae-fa0f11705b3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/c3d5fab69ba2409fbf7223aaf3e8e770/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN Leaf NISSAN Leaf 40 kWh Acenta Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'NISSAN Leaf 40 kWh Acenta Limousine, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982579%27 HTTP/1.1" 200 None
2026-03-25 21:47:12 [ayvens.de] INFO: Saving data for 1982579: {'created_time': 1774475232.730865, 'last_price_update_time': 1774475232.730876, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982579') HTTP/1.1" 204 0
2026-03-25 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 46a43df9-923b-5d9a-88f5-7def564e1bd6 with identifier: 1982577
2026-03-25 21:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 46a43df9-923b-5d9a-88f5-7def564e1bd6 with identifier: 1982577
2026-03-25 21:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 46a43df9-923b-5d9a-88f5-7def564e1bd6 with identifier: 1982577 to the API
2026-03-25 21:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '46a43df9-923b-5d9a-88f5-7def564e1bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-Klasse',
 'odometer': 130834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a43df9-923b-5d9a-88f5-7def564e1bd6/46a43df9-923b-5d9a-88f5-7def564e1bd6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-d/fa5ce58590734e199eaf8100aa135eec/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-Klasse MERCEDES-BENZ C 300 e T 9G-TRONIC Avantgarde '
          'Kombi, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ C 300 e T 9G-TRONIC Avantgarde Kombi, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982577%27 HTTP/1.1" 200 None
2026-03-25 21:47:13 [ayvens.de] INFO: Saving data for 1982577: {'created_time': 1774475233.134562, 'last_price_update_time': 1774475233.134573, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982577') HTTP/1.1" 204 0
2026-03-25 21:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e9a436c7-26d2-5b81-b01b-a3415072d28f with identifier: 1982578
2026-03-25 21:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e9a436c7-26d2-5b81-b01b-a3415072d28f with identifier: 1982578
2026-03-25 21:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e9a436c7-26d2-5b81-b01b-a3415072d28f with identifier: 1982578 to the API
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'e9a436c7-26d2-5b81-b01b-a3415072d28f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 80995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a436c7-26d2-5b81-b01b-a3415072d28f/e9a436c7-26d2-5b81-b01b-a3415072d28f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/3743517fe6d64bbabdc5381c2cbbdd45/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI MINI Mini Cooper Clubman Aut. Classic Trim Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'MINI Mini Cooper Clubman Aut. Classic Trim Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982578%27 HTTP/1.1" 200 None
2026-03-25 21:47:13 [ayvens.de] INFO: Saving data for 1982578: {'created_time': 1774475233.485305, 'last_price_update_time': 1774475233.485315, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982578') HTTP/1.1" 204 0
2026-03-25 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b654f10>
2026-03-25 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fa297dc8eb69b42be960e64a384a11e78%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/8.jpg saved to cache
2026-03-25 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30f120d3-15d6-5d34-bc43-018b8f79073d
2026-03-25 21:47:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30f120d3-15d6-5d34-bc43-018b8f79073d, skipping ID generation
2026-03-25 21:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f120d3-15d6-5d34-bc43-018b8f79073d with scrape type 1
2026-03-25 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30f120d3-15d6-5d34-bc43-018b8f79073d sending to next pipeline
2026-03-25 21:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 30f120d3-15d6-5d34-bc43-018b8f79073d, identifier: 1982571
2026-03-25 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 30f120d3-15d6-5d34-bc43-018b8f79073d with identifier: 1982571
2026-03-25 21:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 30f120d3-15d6-5d34-bc43-018b8f79073d with identifier: 1982571
2026-03-25 21:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 30f120d3-15d6-5d34-bc43-018b8f79073d with identifier: 1982571 to the API
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '30f120d3-15d6-5d34-bc43-018b8f79073d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Fiesta',
 'odometer': 75084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f120d3-15d6-5d34-bc43-018b8f79073d/30f120d3-15d6-5d34-bc43-018b8f79073d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/a297dc8eb69b42be960e64a384a11e78/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Fiesta FORD Fiesta 1.5 TDCi S&S COOL&CONNECT Limousine, '
          '3-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Fiesta 1.5 TDCi S&S COOL&CONNECT Limousine, 3-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982571%27 HTTP/1.1" 200 None
2026-03-25 21:47:14 [ayvens.de] INFO: Saving data for 1982571: {'created_time': 1774475234.051932, 'last_price_update_time': 1774475234.051946, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982571') HTTP/1.1" 204 0
2026-03-25 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813097e350>
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/8.jpg saved to cache
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b660350>
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-l%252F01404b42a72844cd8597eb08971825c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/5.jpg saved to cache
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df6d3d98-9d36-50e1-b747-1136681ee7ad
2026-03-25 21:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df6d3d98-9d36-50e1-b747-1136681ee7ad, skipping ID generation
2026-03-25 21:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df6d3d98-9d36-50e1-b747-1136681ee7ad with scrape type 1
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df6d3d98-9d36-50e1-b747-1136681ee7ad sending to next pipeline
2026-03-25 21:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: df6d3d98-9d36-50e1-b747-1136681ee7ad, identifier: 1982573
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130993f90>
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/6.jpg saved to cache
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067d510>
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnwm%252Fcbfb18bfabb14f2cb0c4d1901c78402b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/7.jpg saved to cache
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31f246c2-a774-5fac-95ce-f0b21d44722a
2026-03-25 21:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31f246c2-a774-5fac-95ce-f0b21d44722a, skipping ID generation
2026-03-25 21:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31f246c2-a774-5fac-95ce-f0b21d44722a with scrape type 1
2026-03-25 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31f246c2-a774-5fac-95ce-f0b21d44722a sending to next pipeline
2026-03-25 21:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 31f246c2-a774-5fac-95ce-f0b21d44722a, identifier: 1982574
2026-03-25 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: df6d3d98-9d36-50e1-b747-1136681ee7ad with identifier: 1982573
2026-03-25 21:47:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: df6d3d98-9d36-50e1-b747-1136681ee7ad with identifier: 1982573
2026-03-25 21:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: df6d3d98-9d36-50e1-b747-1136681ee7ad with identifier: 1982573 to the API
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.1L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'df6d3d98-9d36-50e1-b747-1136681ee7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Fiesta',
 'odometer': 43063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6d3d98-9d36-50e1-b747-1136681ee7ad/df6d3d98-9d36-50e1-b747-1136681ee7ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-l/01404b42a72844cd8597eb08971825c8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Fiesta FORD Fiesta 1.1 S&S COOL&CONNECT Limousine, 3-türig, '
          '5-Gang',
 'transmission': 'manual',
 'trim': 'FORD Fiesta 1.1 S&S COOL&CONNECT Limousine, 3-türig, 5-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982573%27 HTTP/1.1" 200 None
2026-03-25 21:47:15 [ayvens.de] INFO: Saving data for 1982573: {'created_time': 1774475235.007238, 'last_price_update_time': 1774475235.007248, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982573') HTTP/1.1" 204 0
2026-03-25 21:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 31f246c2-a774-5fac-95ce-f0b21d44722a with identifier: 1982574
2026-03-25 21:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 31f246c2-a774-5fac-95ce-f0b21d44722a with identifier: 1982574
2026-03-25 21:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 31f246c2-a774-5fac-95ce-f0b21d44722a with identifier: 1982574 to the API
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '31f246c2-a774-5fac-95ce-f0b21d44722a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 70162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31f246c2-a774-5fac-95ce-f0b21d44722a/31f246c2-a774-5fac-95ce-f0b21d44722a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nwm/cbfb18bfabb14f2cb0c4d1901c78402b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982574%27 HTTP/1.1" 200 None
2026-03-25 21:47:15 [ayvens.de] INFO: Saving data for 1982574: {'created_time': 1774475235.367789, 'last_price_update_time': 1774475235.3678, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982574') HTTP/1.1" 204 0
2026-03-25 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130950750>
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F8a7e490deb054c90b595aceb1d7a771b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/7.jpg saved to cache
2026-03-25 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf
2026-03-25 21:47:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5716b87-1179-5cf2-9bb7-445ca9c6dcbf, skipping ID generation
2026-03-25 21:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf with scrape type 1
2026-03-25 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5716b87-1179-5cf2-9bb7-445ca9c6dcbf sending to next pipeline
2026-03-25 21:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b5716b87-1179-5cf2-9bb7-445ca9c6dcbf, identifier: 1982576
2026-03-25 21:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b5716b87-1179-5cf2-9bb7-445ca9c6dcbf with identifier: 1982576
2026-03-25 21:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b5716b87-1179-5cf2-9bb7-445ca9c6dcbf with identifier: 1982576
2026-03-25 21:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b5716b87-1179-5cf2-9bb7-445ca9c6dcbf with identifier: 1982576 to the API
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5716b87-1179-5cf2-9bb7-445ca9c6dcbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Connect',
 'odometer': 188255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5716b87-1179-5cf2-9bb7-445ca9c6dcbf/b5716b87-1179-5cf2-9bb7-445ca9c6dcbf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/8a7e490deb054c90b595aceb1d7a771b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD Transit Connect FORD Transit Connect 210 L2 S&S Trend Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Connect 210 L2 S&S Trend Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982576%27 HTTP/1.1" 200 None
2026-03-25 21:47:15 [ayvens.de] INFO: Saving data for 1982576: {'created_time': 1774475235.892635, 'last_price_update_time': 1774475235.892645, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982576') HTTP/1.1" 204 0
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b63dd90>
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/10.jpg saved to cache
2026-03-25 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130704490>
2026-03-25 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/9.jpg saved to cache
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e9c290>
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/8.jpg saved to cache
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a175d0>
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwzl%252Fc3327c66567945ff9dc410149bfb3142%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/7.jpg saved to cache
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e20fdce2-501d-5d02-b9b1-c8a17d617a39
2026-03-25 21:47:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e20fdce2-501d-5d02-b9b1-c8a17d617a39, skipping ID generation
2026-03-25 21:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e20fdce2-501d-5d02-b9b1-c8a17d617a39 with scrape type 1
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e20fdce2-501d-5d02-b9b1-c8a17d617a39 sending to next pipeline
2026-03-25 21:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e20fdce2-501d-5d02-b9b1-c8a17d617a39, identifier: 1982570
2026-03-25 21:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e20fdce2-501d-5d02-b9b1-c8a17d617a39 with identifier: 1982570
2026-03-25 21:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e20fdce2-501d-5d02-b9b1-c8a17d617a39 with identifier: 1982570
2026-03-25 21:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e20fdce2-501d-5d02-b9b1-c8a17d617a39 with identifier: 1982570 to the API
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'e20fdce2-501d-5d02-b9b1-c8a17d617a39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Fiesta',
 'odometer': 100096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e20fdce2-501d-5d02-b9b1-c8a17d617a39/e20fdce2-501d-5d02-b9b1-c8a17d617a39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wzl/c3327c66567945ff9dc410149bfb3142/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Fiesta FORD Fiesta 1.0 EcoBoost S&S COOL&CONNECT Limousine, '
          '5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Fiesta 1.0 EcoBoost S&S COOL&CONNECT Limousine, 5-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982570%27 HTTP/1.1" 200 None
2026-03-25 21:47:16 [ayvens.de] INFO: Saving data for 1982570: {'created_time': 1774475236.704715, 'last_price_update_time': 1774475236.704725, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982570') HTTP/1.1" 204 0
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813067f810>
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/7.jpg saved to cache
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a503890>
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/8.jpg saved to cache
2026-03-25 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a352d0>
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/7.jpg saved to cache
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064ae90>
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252F4332d06e8579400da9da58de5cbdd294%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/6.jpg saved to cache
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-25 21:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2, skipping ID generation
2026-03-25 21:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 1
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 sending to next pipeline
2026-03-25 21:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2, identifier: 1982569
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130707e10>
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/7.jpg saved to cache
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81325db2d0>
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252Fbfa9aa966e9746309162196e567af318%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/6.jpg saved to cache
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-25 21:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da284d19-31cb-5c93-9976-fd28ea9fe5bd, skipping ID generation
2026-03-25 21:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 1
2026-03-25 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da284d19-31cb-5c93-9976-fd28ea9fe5bd sending to next pipeline
2026-03-25 21:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: da284d19-31cb-5c93-9976-fd28ea9fe5bd, identifier: 1982567
2026-03-25 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1982569
2026-03-25 21:47:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1982569
2026-03-25 21:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1982569 to the API
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': '34e4ce32-4ccd-5eaa-8527-6989631e5ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'DS7',
 'odometer': 159688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/4332d06e8579400da9da58de5cbdd294/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN DS7 CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE '
          'LINE + Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE LINE + '
         'Geschlossen, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982569%27 HTTP/1.1" 200 None
2026-03-25 21:47:17 [ayvens.de] INFO: Saving data for 1982569: {'created_time': 1774475237.881608, 'last_price_update_time': 1774475237.881618, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982569') HTTP/1.1" 204 0
2026-03-25 21:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1982567
2026-03-25 21:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1982567
2026-03-25 21:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1982567 to the API
2026-03-25 21:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'da284d19-31cb-5c93-9976-fd28ea9fe5bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 141479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/bfa9aa966e9746309162196e567af318/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982567%27 HTTP/1.1" 200 None
2026-03-25 21:47:18 [ayvens.de] INFO: Saving data for 1982567: {'created_time': 1774475238.270363, 'last_price_update_time': 1774475238.270377, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982567') HTTP/1.1" 204 0
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6d4e90>
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F56cb5d6c3077459a933175e5252ff412%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/6.jpg saved to cache
2026-03-25 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-25 21:47:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1, skipping ID generation
2026-03-25 21:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with scrape type 1
2026-03-25 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 sending to next pipeline
2026-03-25 21:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1, identifier: 1982568
2026-03-25 21:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1982568
2026-03-25 21:47:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1982568
2026-03-25 21:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1982568 to the API
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz Uni',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3er',
 'odometer': 112854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/56cb5d6c3077459a933175e5252ff412/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er BMW 320d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 320d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982568%27 HTTP/1.1" 200 None
2026-03-25 21:47:18 [ayvens.de] INFO: Saving data for 1982568: {'created_time': 1774475238.84773, 'last_price_update_time': 1774475238.847739, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982568') HTTP/1.1" 204 0
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130fb2f90>
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/7.jpg saved to cache
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130dc0a90>
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm%25C3%25BCr%252Feab0568929fe4cd284b2ae19a0e90365%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/7.jpg saved to cache
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e50329b5-3250-5dfe-bcf4-da8acec6be94
2026-03-25 21:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e50329b5-3250-5dfe-bcf4-da8acec6be94, skipping ID generation
2026-03-25 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50329b5-3250-5dfe-bcf4-da8acec6be94 with scrape type 1
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e50329b5-3250-5dfe-bcf4-da8acec6be94 sending to next pipeline
2026-03-25 21:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e50329b5-3250-5dfe-bcf4-da8acec6be94, identifier: 1982563
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038c7d0>
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/7.jpg saved to cache
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130dc12d0>
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/7.jpg saved to cache
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b680c90>
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F791ed3c3d2704e1987e4bfa2c6818138%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/6.jpg saved to cache
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85
2026-03-25 21:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 959feb11-3f0f-5fb7-b952-5e4c4dc79f85, skipping ID generation
2026-03-25 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85 with scrape type 1
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 959feb11-3f0f-5fb7-b952-5e4c4dc79f85 sending to next pipeline
2026-03-25 21:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 959feb11-3f0f-5fb7-b952-5e4c4dc79f85, identifier: 1982564
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b605b90>
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252Fe066a7588c80472dbd35351f6765fc92%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/6.jpg saved to cache
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-25 21:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa3bcc8d-1ce2-540f-a98f-adac47df2244, skipping ID generation
2026-03-25 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3bcc8d-1ce2-540f-a98f-adac47df2244 with scrape type 1
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa3bcc8d-1ce2-540f-a98f-adac47df2244 sending to next pipeline
2026-03-25 21:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fa3bcc8d-1ce2-540f-a98f-adac47df2244, identifier: 1982565
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a619d0>
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F02286bc4e77d4a1ca5cf8341ab6e0a2a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/6.jpg saved to cache
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-25 21:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef, skipping ID generation
2026-03-25 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with scrape type 1
2026-03-25 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef sending to next pipeline
2026-03-25 21:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef, identifier: 1982566
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69ddd0>
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/10.jpg saved to cache
2026-03-25 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e50329b5-3250-5dfe-bcf4-da8acec6be94 with identifier: 1982563
2026-03-25 21:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e50329b5-3250-5dfe-bcf4-da8acec6be94 with identifier: 1982563
2026-03-25 21:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e50329b5-3250-5dfe-bcf4-da8acec6be94 with identifier: 1982563 to the API
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'e50329b5-3250-5dfe-bcf4-da8acec6be94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 108888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e50329b5-3250-5dfe-bcf4-da8acec6be94/e50329b5-3250-5dfe-bcf4-da8acec6be94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m%C3%BCr/eab0568929fe4cd284b2ae19a0e90365/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982563%27 HTTP/1.1" 200 None
2026-03-25 21:47:20 [ayvens.de] INFO: Saving data for 1982563: {'created_time': 1774475240.381702, 'last_price_update_time': 1774475240.381712, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982563') HTTP/1.1" 204 0
2026-03-25 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 959feb11-3f0f-5fb7-b952-5e4c4dc79f85 with identifier: 1982564
2026-03-25 21:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 959feb11-3f0f-5fb7-b952-5e4c4dc79f85 with identifier: 1982564
2026-03-25 21:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 959feb11-3f0f-5fb7-b952-5e4c4dc79f85 with identifier: 1982564 to the API
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '959feb11-3f0f-5fb7-b952-5e4c4dc79f85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.3',
 'odometer': 48152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959feb11-3f0f-5fb7-b952-5e4c4dc79f85/959feb11-3f0f-5fb7-b952-5e4c4dc79f85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/791ed3c3d2704e1987e4bfa2c6818138/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.3 VW ID.3 Performance Upgrade Pro Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'VW ID.3 Performance Upgrade Pro Limousine, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982564%27 HTTP/1.1" 200 None
2026-03-25 21:47:20 [ayvens.de] INFO: Saving data for 1982564: {'created_time': 1774475240.747443, 'last_price_update_time': 1774475240.747453, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982564') HTTP/1.1" 204 0
2026-03-25 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1982565
2026-03-25 21:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1982565
2026-03-25 21:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1982565 to the API
2026-03-25 21:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'fa3bcc8d-1ce2-540f-a98f-adac47df2244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 173552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/e066a7588c80472dbd35351f6765fc92/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 AUDI A3 30 TFSI Limousine S tronic Limousine, 4-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A3 30 TFSI Limousine S tronic Limousine, 4-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982565%27 HTTP/1.1" 200 None
2026-03-25 21:47:21 [ayvens.de] INFO: Saving data for 1982565: {'created_time': 1774475241.153018, 'last_price_update_time': 1774475241.15303, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982565') HTTP/1.1" 204 0
2026-03-25 21:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1982566
2026-03-25 21:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1982566
2026-03-25 21:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1982566 to the API
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'c9d2f660-ccbd-5ba6-95e7-33b20ed27eef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 166466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/02286bc4e77d4a1ca5cf8341ab6e0a2a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 35 TFSI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 35 TFSI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982566%27 HTTP/1.1" 200 None
2026-03-25 21:47:21 [ayvens.de] INFO: Saving data for 1982566: {'created_time': 1774475241.535694, 'last_price_update_time': 1774475241.535705, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982566') HTTP/1.1" 204 0
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305fd0d0>
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/10.jpg saved to cache
2026-03-25 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f5710>
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fre-%252Fb7d680dc74bf4ced9c215d1119b82b87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/1.jpg saved to cache
2026-03-25 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47684643-4d92-51a0-af36-a2b15c10f652
2026-03-25 21:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47684643-4d92-51a0-af36-a2b15c10f652, skipping ID generation
2026-03-25 21:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47684643-4d92-51a0-af36-a2b15c10f652 with scrape type 1
2026-03-25 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47684643-4d92-51a0-af36-a2b15c10f652 sending to next pipeline
2026-03-25 21:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 47684643-4d92-51a0-af36-a2b15c10f652, identifier: 1982562
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130359f10>
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/10.jpg saved to cache
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bca790>
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F4a356739e7ab4a139b496c5198714562%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/9.jpg saved to cache
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3
2026-03-25 21:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3, skipping ID generation
2026-03-25 21:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3 with scrape type 1
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3 sending to next pipeline
2026-03-25 21:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3, identifier: 1982561
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b61dc10>
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/1.jpg saved to cache
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bc8650>
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/8.jpg saved to cache
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b607c50>
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdd-%252Fa9f4b96b76584bfb86f691ff634c6832%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/9.jpg saved to cache
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bad8d1d8-884d-56b1-9bec-c8788c580c25
2026-03-25 21:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bad8d1d8-884d-56b1-9bec-c8788c580c25, skipping ID generation
2026-03-25 21:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bad8d1d8-884d-56b1-9bec-c8788c580c25 with scrape type 1
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bad8d1d8-884d-56b1-9bec-c8788c580c25 sending to next pipeline
2026-03-25 21:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: bad8d1d8-884d-56b1-9bec-c8788c580c25, identifier: 1982559
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d14fd0>
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/9.jpg saved to cache
2026-03-25 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 47684643-4d92-51a0-af36-a2b15c10f652 with identifier: 1982562
2026-03-25 21:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 47684643-4d92-51a0-af36-a2b15c10f652 with identifier: 1982562
2026-03-25 21:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 47684643-4d92-51a0-af36-a2b15c10f652 with identifier: 1982562 to the API
2026-03-25 21:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '47684643-4d92-51a0-af36-a2b15c10f652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model 3',
 'odometer': 117022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 875634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47684643-4d92-51a0-af36-a2b15c10f652/47684643-4d92-51a0-af36-a2b15c10f652_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/re-/b7d680dc74bf4ced9c215d1119b82b87/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model 3 TESLA Model 3 Langstreckenbatt. Allradantrieb Dual '
          'Motor Performance Limousine, 4-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model 3 Langstreckenbatt. Allradantrieb Dual Motor Performance '
         'Limousine, 4-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982562%27 HTTP/1.1" 200 None
2026-03-25 21:47:23 [ayvens.de] INFO: Saving data for 1982562: {'created_time': 1774475243.184208, 'last_price_update_time': 1774475243.184219, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982562') HTTP/1.1" 204 0
2026-03-25 21:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3 with identifier: 1982561
2026-03-25 21:47:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3 with identifier: 1982561
2026-03-25 21:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3 with identifier: 1982561 to the API
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Lava',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 134808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3/6b1e875c-3982-5f5d-a3e9-c2bb0fa28ad3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/4a356739e7ab4a139b496c5198714562/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia SKODA Octavia Combi 2.0 TDI DSG 4x4 Scout Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'SKODA Octavia Combi 2.0 TDI DSG 4x4 Scout Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982561%27 HTTP/1.1" 200 None
2026-03-25 21:47:23 [ayvens.de] INFO: Saving data for 1982561: {'created_time': 1774475243.560694, 'last_price_update_time': 1774475243.560707, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982561') HTTP/1.1" 204 0
2026-03-25 21:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: bad8d1d8-884d-56b1-9bec-c8788c580c25 with identifier: 1982559
2026-03-25 21:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: bad8d1d8-884d-56b1-9bec-c8788c580c25 with identifier: 1982559
2026-03-25 21:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: bad8d1d8-884d-56b1-9bec-c8788c580c25 with identifier: 1982559 to the API
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bad8d1d8-884d-56b1-9bec-c8788c580c25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 79279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad8d1d8-884d-56b1-9bec-c8788c580c25/bad8d1d8-884d-56b1-9bec-c8788c580c25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dd-/a9f4b96b76584bfb86f691ff634c6832/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort '
          'Kasten, 3-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort Kasten, 3-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982559%27 HTTP/1.1" 200 None
2026-03-25 21:47:23 [ayvens.de] INFO: Saving data for 1982559: {'created_time': 1774475243.949786, 'last_price_update_time': 1774475243.949799, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982559') HTTP/1.1" 204 0
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b96390>
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmol%252F9f82670119454b888945c0f960bffcf2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/8.jpg saved to cache
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db95b704-3f8c-59df-a904-76f06a5d30f6
2026-03-25 21:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db95b704-3f8c-59df-a904-76f06a5d30f6, skipping ID generation
2026-03-25 21:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db95b704-3f8c-59df-a904-76f06a5d30f6 with scrape type 1
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db95b704-3f8c-59df-a904-76f06a5d30f6 sending to next pipeline
2026-03-25 21:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: db95b704-3f8c-59df-a904-76f06a5d30f6, identifier: 1982558
2026-03-25 21:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: db95b704-3f8c-59df-a904-76f06a5d30f6 with identifier: 1982558
2026-03-25 21:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: db95b704-3f8c-59df-a904-76f06a5d30f6 with identifier: 1982558
2026-03-25 21:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: db95b704-3f8c-59df-a904-76f06a5d30f6 with identifier: 1982558 to the API
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'db95b704-3f8c-59df-a904-76f06a5d30f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 170546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db95b704-3f8c-59df-a904-76f06a5d30f6/db95b704-3f8c-59df-a904-76f06a5d30f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mol/9f82670119454b888945c0f960bffcf2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 EDC L2H1 3,0t '
          'Komfort Kasten, 4-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'RENAULT Trafic ENERGY dCi 145 EDC L2H1 3,0t Komfort Kasten, 4-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982558%27 HTTP/1.1" 200 None
2026-03-25 21:47:24 [ayvens.de] INFO: Saving data for 1982558: {'created_time': 1774475244.610514, 'last_price_update_time': 1774475244.610524, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982558') HTTP/1.1" 204 0
2026-03-25 21:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d05110>
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/9.jpg saved to cache
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306736d0>
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/7.jpg saved to cache
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a63590>
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/9.jpg saved to cache
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130672350>
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F1e5098acb6824e8d9743dc7bce2e675f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/8.jpg saved to cache
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 898c03d8-00be-546b-b630-ee73f68941f2
2026-03-25 21:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 898c03d8-00be-546b-b630-ee73f68941f2, skipping ID generation
2026-03-25 21:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898c03d8-00be-546b-b630-ee73f68941f2 with scrape type 1
2026-03-25 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 898c03d8-00be-546b-b630-ee73f68941f2 sending to next pipeline
2026-03-25 21:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 898c03d8-00be-546b-b630-ee73f68941f2, identifier: 1982557
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6c1c10>
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F2b6b29932f904f76a496d578eb3850f2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/10.jpg saved to cache
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e
2026-03-25 21:47:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d776eb25-d7fd-58f7-af2e-ffb6c15c429e, skipping ID generation
2026-03-25 21:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e with scrape type 1
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d776eb25-d7fd-58f7-af2e-ffb6c15c429e sending to next pipeline
2026-03-25 21:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d776eb25-d7fd-58f7-af2e-ffb6c15c429e, identifier: 1982555
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bc8a10>
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhs-%252Fed08fe58c14c4a7cb234bea222d4d654%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/8.jpg saved to cache
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30b348b7-eba5-55eb-8e5b-a5355c32d142
2026-03-25 21:47:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30b348b7-eba5-55eb-8e5b-a5355c32d142, skipping ID generation
2026-03-25 21:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b348b7-eba5-55eb-8e5b-a5355c32d142 with scrape type 1
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30b348b7-eba5-55eb-8e5b-a5355c32d142 sending to next pipeline
2026-03-25 21:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 30b348b7-eba5-55eb-8e5b-a5355c32d142, identifier: 1982556
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a60f50>
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/9.jpg saved to cache
2026-03-25 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 898c03d8-00be-546b-b630-ee73f68941f2 with identifier: 1982557
2026-03-25 21:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 898c03d8-00be-546b-b630-ee73f68941f2 with identifier: 1982557
2026-03-25 21:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 898c03d8-00be-546b-b630-ee73f68941f2 with identifier: 1982557 to the API
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '898c03d8-00be-546b-b630-ee73f68941f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 101887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898c03d8-00be-546b-b630-ee73f68941f2/898c03d8-00be-546b-b630-ee73f68941f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/1e5098acb6824e8d9743dc7bce2e675f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 317 CDI Sprinter Standard HA '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ 317 CDI Sprinter Standard HA Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982557%27 HTTP/1.1" 200 None
2026-03-25 21:47:25 [ayvens.de] INFO: Saving data for 1982557: {'created_time': 1774475245.845139, 'last_price_update_time': 1774475245.845149, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982557') HTTP/1.1" 204 0
2026-03-25 21:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d776eb25-d7fd-58f7-af2e-ffb6c15c429e with identifier: 1982555
2026-03-25 21:47:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d776eb25-d7fd-58f7-af2e-ffb6c15c429e with identifier: 1982555
2026-03-25 21:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d776eb25-d7fd-58f7-af2e-ffb6c15c429e with identifier: 1982555 to the API
2026-03-25 21:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd776eb25-d7fd-58f7-af2e-ffb6c15c429e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Sorento',
 'odometer': 39837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d776eb25-d7fd-58f7-af2e-ffb6c15c429e/d776eb25-d7fd-58f7-af2e-ffb6c15c429e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/2b6b29932f904f76a496d578eb3850f2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sorento KIA Sorento 2.2 CRDi DCT8 AWD Platinum Geschlossen, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Sorento 2.2 CRDi DCT8 AWD Platinum Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982555%27 HTTP/1.1" 200 None
2026-03-25 21:47:26 [ayvens.de] INFO: Saving data for 1982555: {'created_time': 1774475246.206855, 'last_price_update_time': 1774475246.206865, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982555') HTTP/1.1" 204 0
2026-03-25 21:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 30b348b7-eba5-55eb-8e5b-a5355c32d142 with identifier: 1982556
2026-03-25 21:47:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 30b348b7-eba5-55eb-8e5b-a5355c32d142 with identifier: 1982556
2026-03-25 21:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 30b348b7-eba5-55eb-8e5b-a5355c32d142 with identifier: 1982556 to the API
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Carrarawei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '30b348b7-eba5-55eb-8e5b-a5355c32d142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 66926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b348b7-eba5-55eb-8e5b-a5355c32d142/30b348b7-eba5-55eb-8e5b-a5355c32d142_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hs-/ed08fe58c14c4a7cb234bea222d4d654/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Vision '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Vision Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982556%27 HTTP/1.1" 200 None
2026-03-25 21:47:26 [ayvens.de] INFO: Saving data for 1982556: {'created_time': 1774475246.598206, 'last_price_update_time': 1774475246.598215, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982556') HTTP/1.1" 204 0
2026-03-25 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306a4150>
2026-03-25 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252F4f08bd7be3fd475099c19bbe106c7f7f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/8.jpg saved to cache
2026-03-25 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c
2026-03-25 21:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c, skipping ID generation
2026-03-25 21:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c with scrape type 1
2026-03-25 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c sending to next pipeline
2026-03-25 21:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c, identifier: 1982554
2026-03-25 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c with identifier: 1982554
2026-03-25 21:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c with identifier: 1982554
2026-03-25 21:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c with identifier: 1982554 to the API
2026-03-25 21:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 59912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c/6f09f7c6-caa9-571d-90b4-1e8b5bfd7b2c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/4f08bd7be3fd475099c19bbe106c7f7f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982554%27 HTTP/1.1" 200 None
2026-03-25 21:47:27 [ayvens.de] INFO: Saving data for 1982554: {'created_time': 1774475247.199275, 'last_price_update_time': 1774475247.199286, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982554') HTTP/1.1" 204 0
2026-03-25 21:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130662750>
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/9.jpg saved to cache
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130895e10>
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/10.jpg saved to cache
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b94f50>
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/8.jpg saved to cache
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130dc3e10>
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252Fc1fdda78c7954d25805d00007a4b08f2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/2.jpg saved to cache
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669
2026-03-25 21:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd7d43a4-91c0-57c7-a190-cdd52a7e8669, skipping ID generation
2026-03-25 21:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669 with scrape type 1
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd7d43a4-91c0-57c7-a190-cdd52a7e8669 sending to next pipeline
2026-03-25 21:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: dd7d43a4-91c0-57c7-a190-cdd52a7e8669, identifier: 1982550
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b660b90>
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F3f357cc0025948fbb3f0338b62526f55%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/7.jpg saved to cache
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efa07153-df1f-5020-8a6f-210afd79d1f0
2026-03-25 21:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efa07153-df1f-5020-8a6f-210afd79d1f0, skipping ID generation
2026-03-25 21:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa07153-df1f-5020-8a6f-210afd79d1f0 with scrape type 1
2026-03-25 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efa07153-df1f-5020-8a6f-210afd79d1f0 sending to next pipeline
2026-03-25 21:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: efa07153-df1f-5020-8a6f-210afd79d1f0, identifier: 1982553
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81308961d0>
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252F524ee3af6be14832b088325d6cfe1652%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/8.jpg saved to cache
2026-03-25 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1820950e-df53-5b89-afa1-ade7a9d49e89
2026-03-25 21:47:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1820950e-df53-5b89-afa1-ade7a9d49e89, skipping ID generation
2026-03-25 21:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1820950e-df53-5b89-afa1-ade7a9d49e89 with scrape type 1
2026-03-25 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1820950e-df53-5b89-afa1-ade7a9d49e89 sending to next pipeline
2026-03-25 21:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1820950e-df53-5b89-afa1-ade7a9d49e89, identifier: 1982552
2026-03-25 21:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: dd7d43a4-91c0-57c7-a190-cdd52a7e8669 with identifier: 1982550
2026-03-25 21:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: dd7d43a4-91c0-57c7-a190-cdd52a7e8669 with identifier: 1982550
2026-03-25 21:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: dd7d43a4-91c0-57c7-a190-cdd52a7e8669 with identifier: 1982550 to the API
2026-03-25 21:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'dd7d43a4-91c0-57c7-a190-cdd52a7e8669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 96198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7d43a4-91c0-57c7-a190-cdd52a7e8669/dd7d43a4-91c0-57c7-a190-cdd52a7e8669_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/c1fdda78c7954d25805d00007a4b08f2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982550%27 HTTP/1.1" 200 None
2026-03-25 21:47:30 [ayvens.de] INFO: Saving data for 1982550: {'created_time': 1774475250.247993, 'last_price_update_time': 1774475250.248004, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982550') HTTP/1.1" 204 0
2026-03-25 21:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: efa07153-df1f-5020-8a6f-210afd79d1f0 with identifier: 1982553
2026-03-25 21:47:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: efa07153-df1f-5020-8a6f-210afd79d1f0 with identifier: 1982553
2026-03-25 21:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: efa07153-df1f-5020-8a6f-210afd79d1f0 with identifier: 1982553 to the API
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schneewei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'efa07153-df1f-5020-8a6f-210afd79d1f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 41506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa07153-df1f-5020-8a6f-210afd79d1f0/efa07153-df1f-5020-8a6f-210afd79d1f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/3f357cc0025948fbb3f0338b62526f55/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982553%27 HTTP/1.1" 200 None
2026-03-25 21:47:30 [ayvens.de] INFO: Saving data for 1982553: {'created_time': 1774475250.629945, 'last_price_update_time': 1774475250.629955, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982553') HTTP/1.1" 204 0
2026-03-25 21:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1820950e-df53-5b89-afa1-ade7a9d49e89 with identifier: 1982552
2026-03-25 21:47:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1820950e-df53-5b89-afa1-ade7a9d49e89 with identifier: 1982552
2026-03-25 21:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1820950e-df53-5b89-afa1-ade7a9d49e89 with identifier: 1982552 to the API
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': '1820950e-df53-5b89-afa1-ade7a9d49e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 51102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1820950e-df53-5b89-afa1-ade7a9d49e89/1820950e-df53-5b89-afa1-ade7a9d49e89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/524ee3af6be14832b088325d6cfe1652/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982552%27 HTTP/1.1" 200 None
2026-03-25 21:47:31 [ayvens.de] INFO: Saving data for 1982552: {'created_time': 1774475251.002306, 'last_price_update_time': 1774475251.002318, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982552') HTTP/1.1" 204 0
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a4acd0>
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/8.jpg saved to cache
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813038fc90>
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/7.jpg saved to cache
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ce950>
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252Ffb7fece9e13d432eb7722679348f80e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/4.jpg saved to cache
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc548c7a-fde5-5719-bd95-11de7881aa2f
2026-03-25 21:47:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc548c7a-fde5-5719-bd95-11de7881aa2f, skipping ID generation
2026-03-25 21:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc548c7a-fde5-5719-bd95-11de7881aa2f with scrape type 1
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc548c7a-fde5-5719-bd95-11de7881aa2f sending to next pipeline
2026-03-25 21:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: bc548c7a-fde5-5719-bd95-11de7881aa2f, identifier: 1982548
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e22f10>
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flau%252F058b38a891514ff4b16f43726a509ff4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/10.jpg saved to cache
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc49bbfb-03ed-592b-9085-39fc3055ea45
2026-03-25 21:47:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc49bbfb-03ed-592b-9085-39fc3055ea45, skipping ID generation
2026-03-25 21:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc49bbfb-03ed-592b-9085-39fc3055ea45 with scrape type 1
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc49bbfb-03ed-592b-9085-39fc3055ea45 sending to next pipeline
2026-03-25 21:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: bc49bbfb-03ed-592b-9085-39fc3055ea45, identifier: 1982545
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a36050>
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/7.jpg saved to cache
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b51d0>
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fb811eae786b5449d8a8a0330f1964a6a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/5.jpg saved to cache
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2ac5847-9796-5cb7-bedc-a81d1ed43107
2026-03-25 21:47:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2ac5847-9796-5cb7-bedc-a81d1ed43107, skipping ID generation
2026-03-25 21:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ac5847-9796-5cb7-bedc-a81d1ed43107 with scrape type 1
2026-03-25 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2ac5847-9796-5cb7-bedc-a81d1ed43107 sending to next pipeline
2026-03-25 21:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a2ac5847-9796-5cb7-bedc-a81d1ed43107, identifier: 1982542
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8133f81410>
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fst-%252F8c6cb7f4da5e4b378a12af28dbfe3100%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/8.jpg saved to cache
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34b8f902-f912-5a61-9ee6-2df5940bac13
2026-03-25 21:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34b8f902-f912-5a61-9ee6-2df5940bac13, skipping ID generation
2026-03-25 21:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34b8f902-f912-5a61-9ee6-2df5940bac13 with scrape type 1
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34b8f902-f912-5a61-9ee6-2df5940bac13 sending to next pipeline
2026-03-25 21:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 34b8f902-f912-5a61-9ee6-2df5940bac13, identifier: 1982540
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306cf750>
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/5.jpg saved to cache
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d12750>
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F013ef9efdd1c4a1db2467ed11db5f5f7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/6.jpg saved to cache
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2269cc8-abd8-5896-9d38-3ba8d9636c67
2026-03-25 21:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2269cc8-abd8-5896-9d38-3ba8d9636c67, skipping ID generation
2026-03-25 21:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2269cc8-abd8-5896-9d38-3ba8d9636c67 with scrape type 1
2026-03-25 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2269cc8-abd8-5896-9d38-3ba8d9636c67 sending to next pipeline
2026-03-25 21:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d2269cc8-abd8-5896-9d38-3ba8d9636c67, identifier: 1982543
2026-03-25 21:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: bc548c7a-fde5-5719-bd95-11de7881aa2f with identifier: 1982548
2026-03-25 21:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: bc548c7a-fde5-5719-bd95-11de7881aa2f with identifier: 1982548
2026-03-25 21:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: bc548c7a-fde5-5719-bd95-11de7881aa2f with identifier: 1982548 to the API
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'bc548c7a-fde5-5719-bd95-11de7881aa2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 58464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc548c7a-fde5-5719-bd95-11de7881aa2f/bc548c7a-fde5-5719-bd95-11de7881aa2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/fb7fece9e13d432eb7722679348f80e2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Single Motor 78kWh '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Single Motor 78kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982548%27 HTTP/1.1" 200 None
2026-03-25 21:47:32 [ayvens.de] INFO: Saving data for 1982548: {'created_time': 1774475252.866422, 'last_price_update_time': 1774475252.866434, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982548') HTTP/1.1" 204 0
2026-03-25 21:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: bc49bbfb-03ed-592b-9085-39fc3055ea45 with identifier: 1982545
2026-03-25 21:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: bc49bbfb-03ed-592b-9085-39fc3055ea45 with identifier: 1982545
2026-03-25 21:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: bc49bbfb-03ed-592b-9085-39fc3055ea45 with identifier: 1982545 to the API
2026-03-25 21:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bc49bbfb-03ed-592b-9085-39fc3055ea45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Vivaro',
 'odometer': 140492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc49bbfb-03ed-592b-9085-39fc3055ea45/bc49bbfb-03ed-592b-9085-39fc3055ea45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lau/058b38a891514ff4b16f43726a509ff4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seats_number': 6,
 'seller_name': None,
 'title': 'OPEL Vivaro OPEL Vivaro 2.0 D M Edition Doppelk.Kasten, 4-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'OPEL Vivaro 2.0 D M Edition Doppelk.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982545%27 HTTP/1.1" 200 None
2026-03-25 21:47:33 [ayvens.de] INFO: Saving data for 1982545: {'created_time': 1774475253.440964, 'last_price_update_time': 1774475253.440975, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982545') HTTP/1.1" 204 0
2026-03-25 21:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a2ac5847-9796-5cb7-bedc-a81d1ed43107 with identifier: 1982542
2026-03-25 21:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a2ac5847-9796-5cb7-bedc-a81d1ed43107 with identifier: 1982542
2026-03-25 21:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a2ac5847-9796-5cb7-bedc-a81d1ed43107 with identifier: 1982542 to the API
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a2ac5847-9796-5cb7-bedc-a81d1ed43107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 120376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ac5847-9796-5cb7-bedc-a81d1ed43107/a2ac5847-9796-5cb7-bedc-a81d1ed43107_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/b811eae786b5449d8a8a0330f1964a6a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 317 CDI Sprinter Standard HA '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ 317 CDI Sprinter Standard HA Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982542%27 HTTP/1.1" 200 None
2026-03-25 21:47:33 [ayvens.de] INFO: Saving data for 1982542: {'created_time': 1774475253.813673, 'last_price_update_time': 1774475253.813683, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982542') HTTP/1.1" 204 0
2026-03-25 21:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 34b8f902-f912-5a61-9ee6-2df5940bac13 with identifier: 1982540
2026-03-25 21:47:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 34b8f902-f912-5a61-9ee6-2df5940bac13 with identifier: 1982540
2026-03-25 21:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 34b8f902-f912-5a61-9ee6-2df5940bac13 with identifier: 1982540 to the API
2026-03-25 21:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'other',
 'id': '34b8f902-f912-5a61-9ee6-2df5940bac13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'NEXO',
 'odometer': 41175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b8f902-f912-5a61-9ee6-2df5940bac13/34b8f902-f912-5a61-9ee6-2df5940bac13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/st-/8c6cb7f4da5e4b378a12af28dbfe3100/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI NEXO HYUNDAI NEXO Prime Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI NEXO Prime Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982540%27 HTTP/1.1" 200 None
2026-03-25 21:47:34 [ayvens.de] INFO: Saving data for 1982540: {'created_time': 1774475254.18565, 'last_price_update_time': 1774475254.18566, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982540') HTTP/1.1" 204 0
2026-03-25 21:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d2269cc8-abd8-5896-9d38-3ba8d9636c67 with identifier: 1982543
2026-03-25 21:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d2269cc8-abd8-5896-9d38-3ba8d9636c67 with identifier: 1982543
2026-03-25 21:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d2269cc8-abd8-5896-9d38-3ba8d9636c67 with identifier: 1982543 to the API
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd2269cc8-abd8-5896-9d38-3ba8d9636c67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 159060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 877683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 934363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2269cc8-abd8-5896-9d38-3ba8d9636c67/d2269cc8-abd8-5896-9d38-3ba8d9636c67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/013ef9efdd1c4a1db2467ed11db5f5f7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 516 CDI Sprinter Lang HA '
          '7G-TRONIC Plus Fgst., 2-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ 516 CDI Sprinter Lang HA 7G-TRONIC Plus Fgst., '
         '2-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982543%27 HTTP/1.1" 200 None
2026-03-25 21:47:34 [ayvens.de] INFO: Saving data for 1982543: {'created_time': 1774475254.568903, 'last_price_update_time': 1774475254.568913, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982543') HTTP/1.1" 204 0
2026-03-25 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b6790>
2026-03-25 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F0bd7cb4ee8b84aa0a7e1d47248b1bc62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/8.jpg saved to cache
2026-03-25 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8
2026-03-25 21:47:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4919e9c-2cf3-5d66-b86f-5f65ae50dec8, skipping ID generation
2026-03-25 21:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8 with scrape type 1
2026-03-25 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4919e9c-2cf3-5d66-b86f-5f65ae50dec8 sending to next pipeline
2026-03-25 21:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: c4919e9c-2cf3-5d66-b86f-5f65ae50dec8, identifier: 1982539
2026-03-25 21:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: c4919e9c-2cf3-5d66-b86f-5f65ae50dec8 with identifier: 1982539
2026-03-25 21:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: c4919e9c-2cf3-5d66-b86f-5f65ae50dec8 with identifier: 1982539
2026-03-25 21:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: c4919e9c-2cf3-5d66-b86f-5f65ae50dec8 with identifier: 1982539 to the API
2026-03-25 21:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'c4919e9c-2cf3-5d66-b86f-5f65ae50dec8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 10644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4919e9c-2cf3-5d66-b86f-5f65ae50dec8/c4919e9c-2cf3-5d66-b86f-5f65ae50dec8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/0bd7cb4ee8b84aa0a7e1d47248b1bc62/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI KONA EV Select Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI KONA EV Select Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982539%27 HTTP/1.1" 200 None
2026-03-25 21:47:35 [ayvens.de] INFO: Saving data for 1982539: {'created_time': 1774475255.203502, 'last_price_update_time': 1774475255.203513, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982539') HTTP/1.1" 204 0
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d4f990>
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/8.jpg saved to cache
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b7c390>
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/10.jpg saved to cache
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d5ad90>
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/9.jpg saved to cache
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81305f4290>
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-t%252F0dbaaf1ee78540b4afe5edf475143c66%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/7.jpg saved to cache
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e
2026-03-25 21:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9cd2608-4de7-5fc0-a5c6-851c86a01e7e, skipping ID generation
2026-03-25 21:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e with scrape type 1
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9cd2608-4de7-5fc0-a5c6-851c86a01e7e sending to next pipeline
2026-03-25 21:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a9cd2608-4de7-5fc0-a5c6-851c86a01e7e, identifier: 1982536
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b7890>
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/8.jpg saved to cache
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ac8d50>
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/7.jpg saved to cache
2026-03-25 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813064bad0>
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-w%252F5224c2641c7f4304afa31fc062353de3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/2.jpg saved to cache
2026-03-25 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b58d049-32b4-5dae-86f9-55140e392142
2026-03-25 21:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b58d049-32b4-5dae-86f9-55140e392142, skipping ID generation
2026-03-25 21:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b58d049-32b4-5dae-86f9-55140e392142 with scrape type 1
2026-03-25 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b58d049-32b4-5dae-86f9-55140e392142 sending to next pipeline
2026-03-25 21:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1b58d049-32b4-5dae-86f9-55140e392142, identifier: 1982537
2026-03-25 21:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b640890>
2026-03-25 21:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmtk%252F82296e1b263246fa88b36fe3432322ce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/9.jpg saved to cache
2026-03-25 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17f23685-5e76-5edd-8591-31392e5350ae
2026-03-25 21:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17f23685-5e76-5edd-8591-31392e5350ae, skipping ID generation
2026-03-25 21:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f23685-5e76-5edd-8591-31392e5350ae with scrape type 1
2026-03-25 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17f23685-5e76-5edd-8591-31392e5350ae sending to next pipeline
2026-03-25 21:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 17f23685-5e76-5edd-8591-31392e5350ae, identifier: 1982538
2026-03-25 21:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a9cd2608-4de7-5fc0-a5c6-851c86a01e7e with identifier: 1982536
2026-03-25 21:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a9cd2608-4de7-5fc0-a5c6-851c86a01e7e with identifier: 1982536
2026-03-25 21:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a9cd2608-4de7-5fc0-a5c6-851c86a01e7e with identifier: 1982536 to the API
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Frost',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a9cd2608-4de7-5fc0-a5c6-851c86a01e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 95803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cd2608-4de7-5fc0-a5c6-851c86a01e7e/a9cd2608-4de7-5fc0-a5c6-851c86a01e7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-t/0dbaaf1ee78540b4afe5edf475143c66/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 330 L2H2 VA Autm. Trend Kombi, 4-türig, '
          'Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Transit 330 L2H2 VA Autm. Trend Kombi, 4-türig, Automatik, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982536%27 HTTP/1.1" 200 None
2026-03-25 21:47:36 [ayvens.de] INFO: Saving data for 1982536: {'created_time': 1774475256.628668, 'last_price_update_time': 1774475256.628679, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982536') HTTP/1.1" 204 0
2026-03-25 21:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1b58d049-32b4-5dae-86f9-55140e392142 with identifier: 1982537
2026-03-25 21:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1b58d049-32b4-5dae-86f9-55140e392142 with identifier: 1982537
2026-03-25 21:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1b58d049-32b4-5dae-86f9-55140e392142 with identifier: 1982537 to the API
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '1b58d049-32b4-5dae-86f9-55140e392142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 51984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 830230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b58d049-32b4-5dae-86f9-55140e392142/1b58d049-32b4-5dae-86f9-55140e392142_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-w/5224c2641c7f4304afa31fc062353de3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 350 L3H2 VA Trend Kombi, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 350 L3H2 VA Trend Kombi, 4-türig, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-25 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982537%27 HTTP/1.1" 200 None
2026-03-25 21:47:37 [ayvens.de] INFO: Saving data for 1982537: {'created_time': 1774475257.007538, 'last_price_update_time': 1774475257.007549, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982537') HTTP/1.1" 204 0
2026-03-25 21:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 17f23685-5e76-5edd-8591-31392e5350ae with identifier: 1982538
2026-03-25 21:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 17f23685-5e76-5edd-8591-31392e5350ae with identifier: 1982538
2026-03-25 21:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 17f23685-5e76-5edd-8591-31392e5350ae with identifier: 1982538 to the API
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '17f23685-5e76-5edd-8591-31392e5350ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Connect',
 'odometer': 33465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f23685-5e76-5edd-8591-31392e5350ae/17f23685-5e76-5edd-8591-31392e5350ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mtk/82296e1b263246fa88b36fe3432322ce/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD Transit Connect TransitConnect   1.,5  EcoBlue  230   (L2) '
          'Trend S/S      ( EUR 2)',
 'transmission': 'manual',
 'trim': 'TransitConnect   1.,5  EcoBlue  230   (L2) Trend S/S      ( EUR 2)',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982538%27 HTTP/1.1" 200 None
2026-03-25 21:47:37 [ayvens.de] INFO: Saving data for 1982538: {'created_time': 1774475257.394122, 'last_price_update_time': 1774475257.394132, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982538') HTTP/1.1" 204 0
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bd7610>
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/8.jpg saved to cache
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b654050>
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/1.jpg saved to cache
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b71350>
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feu-%252F01c9dc8fed224e68afaa2dbe450f8e11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/1.jpg saved to cache
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4
2026-03-25 21:47:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6f61f53-784b-57bf-9fb5-8860ca6c1ec4, skipping ID generation
2026-03-25 21:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4 with scrape type 1
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6f61f53-784b-57bf-9fb5-8860ca6c1ec4 sending to next pipeline
2026-03-25 21:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a6f61f53-784b-57bf-9fb5-8860ca6c1ec4, identifier: 1982533
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130bd4110>
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/8.jpg saved to cache
2026-03-25 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306ce650>
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/7.jpg saved to cache
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6afb50>
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/6.jpg saved to cache
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81306acd90>
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdbr%252Fcfbb22ce6c61432da2ea09a6f5054974%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/2.jpg saved to cache
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6fd199c-32c9-5df8-9774-12e0215536e9
2026-03-25 21:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6fd199c-32c9-5df8-9774-12e0215536e9, skipping ID generation
2026-03-25 21:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fd199c-32c9-5df8-9774-12e0215536e9 with scrape type 1
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6fd199c-32c9-5df8-9774-12e0215536e9 sending to next pipeline
2026-03-25 21:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a6fd199c-32c9-5df8-9774-12e0215536e9, identifier: 1982532
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6434d0>
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F869b40efb2444e64abcb2fa093eee50c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/5.jpg saved to cache
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-25 21:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f61061d5-b02f-5a06-9fae-2f2407055e5e, skipping ID generation
2026-03-25 21:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 1
2026-03-25 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f61061d5-b02f-5a06-9fae-2f2407055e5e sending to next pipeline
2026-03-25 21:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f61061d5-b02f-5a06-9fae-2f2407055e5e, identifier: 1982535
2026-03-25 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a6f61f53-784b-57bf-9fb5-8860ca6c1ec4 with identifier: 1982533
2026-03-25 21:47:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a6f61f53-784b-57bf-9fb5-8860ca6c1ec4 with identifier: 1982533
2026-03-25 21:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a6f61f53-784b-57bf-9fb5-8860ca6c1ec4 with identifier: 1982533 to the API
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'a6f61f53-784b-57bf-9fb5-8860ca6c1ec4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 64058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 964994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6f61f53-784b-57bf-9fb5-8860ca6c1ec4/a6f61f53-784b-57bf-9fb5-8860ca6c1ec4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eu-/01c9dc8fed224e68afaa2dbe450f8e11/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.0 EcoBoost Hybrid ST-LINE Geschlossen, '
          '5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Puma 1.0 EcoBoost Hybrid ST-LINE Geschlossen, 5-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982533%27 HTTP/1.1" 200 None
2026-03-25 21:47:38 [ayvens.de] INFO: Saving data for 1982533: {'created_time': 1774475258.882965, 'last_price_update_time': 1774475258.882975, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982533') HTTP/1.1" 204 0
2026-03-25 21:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a6fd199c-32c9-5df8-9774-12e0215536e9 with identifier: 1982532
2026-03-25 21:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a6fd199c-32c9-5df8-9774-12e0215536e9 with identifier: 1982532
2026-03-25 21:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a6fd199c-32c9-5df8-9774-12e0215536e9 with identifier: 1982532 to the API
2026-03-25 21:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a6fd199c-32c9-5df8-9774-12e0215536e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 28586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fd199c-32c9-5df8-9774-12e0215536e9/a6fd199c-32c9-5df8-9774-12e0215536e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dbr/cfbb22ce6c61432da2ea09a6f5054974/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV TITANIUM Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV TITANIUM Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982532%27 HTTP/1.1" 200 None
2026-03-25 21:47:39 [ayvens.de] INFO: Saving data for 1982532: {'created_time': 1774475259.228505, 'last_price_update_time': 1774475259.228514, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982532') HTTP/1.1" 204 0
2026-03-25 21:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1982535
2026-03-25 21:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1982535
2026-03-25 21:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1982535 to the API
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f61061d5-b02f-5a06-9fae-2f2407055e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 37443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 899567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 931245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 959751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 875205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/869b40efb2444e64abcb2fa093eee50c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982535%27 HTTP/1.1" 200 None
2026-03-25 21:47:39 [ayvens.de] INFO: Saving data for 1982535: {'created_time': 1774475259.575487, 'last_price_update_time': 1774475259.575497, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982535') HTTP/1.1" 204 0
2026-03-25 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6ed250>
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/4.jpg saved to cache
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307074d0>
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/1.jpg saved to cache
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812a5014d0>
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-f%252F1f0d8acff3da44e3bdb792c3b80ec0ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/3.jpg saved to cache
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf2a41df-eaf2-509b-b65e-ff33a672a994
2026-03-25 21:47:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf2a41df-eaf2-509b-b65e-ff33a672a994, skipping ID generation
2026-03-25 21:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2a41df-eaf2-509b-b65e-ff33a672a994 with scrape type 1
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf2a41df-eaf2-509b-b65e-ff33a672a994 sending to next pipeline
2026-03-25 21:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cf2a41df-eaf2-509b-b65e-ff33a672a994, identifier: 1982530
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81307f6210>
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/2.jpg saved to cache
2026-03-25 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cf2a41df-eaf2-509b-b65e-ff33a672a994 with identifier: 1982530
2026-03-25 21:47:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cf2a41df-eaf2-509b-b65e-ff33a672a994 with identifier: 1982530
2026-03-25 21:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cf2a41df-eaf2-509b-b65e-ff33a672a994 with identifier: 1982530 to the API
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'cf2a41df-eaf2-509b-b65e-ff33a672a994',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 51847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 844976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2a41df-eaf2-509b-b65e-ff33a672a994/cf2a41df-eaf2-509b-b65e-ff33a672a994_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-f/1f0d8acff3da44e3bdb792c3b80ec0ef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982530%27 HTTP/1.1" 200 None
2026-03-25 21:47:40 [ayvens.de] INFO: Saving data for 1982530: {'created_time': 1774475260.352105, 'last_price_update_time': 1774475260.352116, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982530') HTTP/1.1" 204 0
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130654610>
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/6.jpg saved to cache
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130a80a50>
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/1.jpg saved to cache
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130609750>
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F5b6730de73584a949f5186a1d7518b01%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/3.jpg saved to cache
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-25 21:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6d4fbc8-7897-53cb-88cc-9c02768efdf3, skipping ID generation
2026-03-25 21:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 1
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 sending to next pipeline
2026-03-25 21:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e6d4fbc8-7897-53cb-88cc-9c02768efdf3, identifier: 1982529
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6eedd0>
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F02ed89fb9b314db88c1b8e49002762d2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/2.jpg saved to cache
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-25 21:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a19b732-745f-542c-b084-ad80d302a120, skipping ID generation
2026-03-25 21:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a19b732-745f-542c-b084-ad80d302a120 with scrape type 1
2026-03-25 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a19b732-745f-542c-b084-ad80d302a120 sending to next pipeline
2026-03-25 21:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8a19b732-745f-542c-b084-ad80d302a120, identifier: 1982528
2026-03-25 21:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1982529
2026-03-25 21:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1982529
2026-03-25 21:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1982529 to the API
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e6d4fbc8-7897-53cb-88cc-9c02768efdf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 63566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/5b6730de73584a949f5186a1d7518b01/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982529%27 HTTP/1.1" 200 None
2026-03-25 21:47:41 [ayvens.de] INFO: Saving data for 1982529: {'created_time': 1774475261.346666, 'last_price_update_time': 1774475261.346676, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982529') HTTP/1.1" 204 0
2026-03-25 21:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1982528
2026-03-25 21:47:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1982528
2026-03-25 21:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1982528 to the API
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '8a19b732-745f-542c-b084-ad80d302a120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Arteon',
 'odometer': 217282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/02ed89fb9b314db88c1b8e49002762d2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Arteon VW Arteon Shooting Brake 2.0 TDI SCR DSG R-Line '
          'Kombi, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'VW Arteon Shooting Brake 2.0 TDI SCR DSG R-Line Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982528%27 HTTP/1.1" 200 None
2026-03-25 21:47:41 [ayvens.de] INFO: Saving data for 1982528: {'created_time': 1774475261.916788, 'last_price_update_time': 1774475261.916799, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982528') HTTP/1.1" 204 0
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69c850>
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F7d791b283b594aa088337da7af5052b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/1.jpg saved to cache
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-25 21:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 311d83dc-371b-5211-95e8-9555407fe223, skipping ID generation
2026-03-25 21:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311d83dc-371b-5211-95e8-9555407fe223 with scrape type 1
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 311d83dc-371b-5211-95e8-9555407fe223 sending to next pipeline
2026-03-25 21:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 311d83dc-371b-5211-95e8-9555407fe223, identifier: 1982527
2026-03-25 21:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1982527
2026-03-25 21:47:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1982527
2026-03-25 21:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1982527 to the API
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Gelb',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '311d83dc-371b-5211-95e8-9555407fe223',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 146564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/7d791b283b594aa088337da7af5052b8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 CRDi Eco-Dynamics+ (48V Mild-Hybrid) SPIRIT '
          'Geschlossen, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'KIA XCeed 1.6 CRDi Eco-Dynamics+ (48V Mild-Hybrid) SPIRIT '
         'Geschlossen, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982527%27 HTTP/1.1" 200 None
2026-03-25 21:47:42 [ayvens.de] INFO: Saving data for 1982527: {'created_time': 1774475262.541384, 'last_price_update_time': 1774475262.541394, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982527') HTTP/1.1" 204 0
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093fdd0>
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/3.jpg saved to cache
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130ab7a50>
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F0d4a9e9ff8634724be59e55157c25fcc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/3.jpg saved to cache
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-25 21:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39c058b7-1536-5792-97e2-c298dcdfc9fc, skipping ID generation
2026-03-25 21:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c058b7-1536-5792-97e2-c298dcdfc9fc with scrape type 1
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39c058b7-1536-5792-97e2-c298dcdfc9fc sending to next pipeline
2026-03-25 21:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 39c058b7-1536-5792-97e2-c298dcdfc9fc, identifier: 1982522
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130d06350>
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F8ba379fab4274729bb474feb8ded4318%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/2.jpg saved to cache
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-25 21:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f26e2664-7e50-51e0-9964-f34a1a67d48b, skipping ID generation
2026-03-25 21:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26e2664-7e50-51e0-9964-f34a1a67d48b with scrape type 1
2026-03-25 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f26e2664-7e50-51e0-9964-f34a1a67d48b sending to next pipeline
2026-03-25 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f26e2664-7e50-51e0-9964-f34a1a67d48b, identifier: 1982525
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130aa2650>
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F65aa42bc74d549dbb7cbf8fef651349d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/10.jpg saved to cache
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-25 21:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb, skipping ID generation
2026-03-25 21:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with scrape type 1
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb sending to next pipeline
2026-03-25 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb, identifier: 1982526
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f813093ed50>
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/3.jpg saved to cache
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130602990>
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F1f24aff9070d45169ad89efece7fceb3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/7.jpg saved to cache
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-25 21:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9ac5b8f-83b7-5935-9efe-bd6038786488, skipping ID generation
2026-03-25 21:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9ac5b8f-83b7-5935-9efe-bd6038786488 sending to next pipeline
2026-03-25 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e9ac5b8f-83b7-5935-9efe-bd6038786488, identifier: 1982524
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b654890>
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_3.jpg HTTP/1.1" 201 0
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F08aefa027b7c4d4cae81885a2104c4c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/4.jpg saved to cache
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-25 21:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23, skipping ID generation
2026-03-25 21:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with scrape type 1
2026-03-25 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 sending to next pipeline
2026-03-25 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23, identifier: 1982521
2026-03-25 21:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1982522
2026-03-25 21:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1982522
2026-03-25 21:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1982522 to the API
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '39c058b7-1536-5792-97e2-c298dcdfc9fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 55520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/0d4a9e9ff8634724be59e55157c25fcc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort '
          'Kasten, 3-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort Kasten, 3-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982522%27 HTTP/1.1" 200 None
2026-03-25 21:47:44 [ayvens.de] INFO: Saving data for 1982522: {'created_time': 1774475264.019556, 'last_price_update_time': 1774475264.019571, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982522') HTTP/1.1" 204 0
2026-03-25 21:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1982525
2026-03-25 21:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1982525
2026-03-25 21:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1982525 to the API
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'na',
 'id': 'f26e2664-7e50-51e0-9964-f34a1a67d48b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'i10',
 'odometer': 29770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/8ba379fab4274729bb474feb8ded4318/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI i10 HYUNDAI i10 1.0 Trend Limousine, 5-türig, 5-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI i10 1.0 Trend Limousine, 5-türig, 5-Gang',
 'vin': None,
 'year': 2019}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982525%27 HTTP/1.1" 200 None
2026-03-25 21:47:44 [ayvens.de] INFO: Saving data for 1982525: {'created_time': 1774475264.341599, 'last_price_update_time': 1774475264.341609, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982525') HTTP/1.1" 204 0
2026-03-25 21:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1982526
2026-03-25 21:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1982526
2026-03-25 21:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1982526 to the API
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef60a3d2-e1f4-5a02-85cf-c46dd99646bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'Santa Fe',
 'odometer': 274386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/65aa42bc74d549dbb7cbf8fef651349d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI Santa Fe HYUNDAI Santa Fe 2.2 CRDi 4WD Automatik Premium '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI Santa Fe 2.2 CRDi 4WD Automatik Premium Geschlossen, '
         '5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982526%27 HTTP/1.1" 200 None
2026-03-25 21:47:44 [ayvens.de] INFO: Saving data for 1982526: {'created_time': 1774475264.670942, 'last_price_update_time': 1774475264.670951, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982526') HTTP/1.1" 204 0
2026-03-25 21:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1982524
2026-03-25 21:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1982524
2026-03-25 21:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1982524 to the API
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9ac5b8f-83b7-5935-9efe-bd6038786488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 43283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/1f24aff9070d45169ad89efece7fceb3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982524%27 HTTP/1.1" 200 None
2026-03-25 21:47:44 [ayvens.de] INFO: Saving data for 1982524: {'created_time': 1774475264.987082, 'last_price_update_time': 1774475264.987092, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982524') HTTP/1.1" 204 0
2026-03-25 21:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1982521
2026-03-25 21:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1982521
2026-03-25 21:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1982521 to the API
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '01b8707b-00ce-5b13-9e2d-bbf8727e0f23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 93012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/08aefa027b7c4d4cae81885a2104c4c7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 317 CDI Sprinter Standard HA '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ 317 CDI Sprinter Standard HA Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982521%27 HTTP/1.1" 200 None
2026-03-25 21:47:45 [ayvens.de] INFO: Saving data for 1982521: {'created_time': 1774475265.319705, 'last_price_update_time': 1774475265.319716, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982521') HTTP/1.1" 204 0
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130c75a10>
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F50d65eb2664846c5b86171015aaab77c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/3.jpg saved to cache
2026-03-25 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-25 21:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72becd66-d34a-5c15-8560-322b276164ff, skipping ID generation
2026-03-25 21:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72becd66-d34a-5c15-8560-322b276164ff with scrape type 1
2026-03-25 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72becd66-d34a-5c15-8560-322b276164ff sending to next pipeline
2026-03-25 21:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 72becd66-d34a-5c15-8560-322b276164ff, identifier: 1982518
2026-03-25 21:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1982518
2026-03-25 21:47:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1982518
2026-03-25 21:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1982518 to the API
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '72becd66-d34a-5c15-8560-322b276164ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 151892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 833002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/50d65eb2664846c5b86171015aaab77c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON HYUNDAI Tucson blue 2.0 CRDi 4WD Aut. N Line '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI Tucson blue 2.0 CRDi 4WD Aut. N Line Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982518%27 HTTP/1.1" 200 None
2026-03-25 21:47:45 [ayvens.de] INFO: Saving data for 1982518: {'created_time': 1774475265.957949, 'last_price_update_time': 1774475265.957961, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982518') HTTP/1.1" 204 0
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130e07590>
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F181d4db3341e4bbdbce17c413570cfa2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/6.jpg saved to cache
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-25 21:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d72b9397-852a-5550-89f5-edd56a131f9a, skipping ID generation
2026-03-25 21:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d72b9397-852a-5550-89f5-edd56a131f9a sending to next pipeline
2026-03-25 21:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d72b9397-852a-5550-89f5-edd56a131f9a, identifier: 1982513
2026-03-25 21:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1982513
2026-03-25 21:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1982513
2026-03-25 21:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1982513 to the API
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd72b9397-852a-5550-89f5-edd56a131f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Discovery Sport',
 'odometer': 64253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/181d4db3341e4bbdbce17c413570cfa2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Discovery Sport LAND ROVER Discovery Sport P300e '
          'R-Dynamic S Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Discovery Sport P300e R-Dynamic S Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982513%27 HTTP/1.1" 200 None
2026-03-25 21:47:46 [ayvens.de] INFO: Saving data for 1982513: {'created_time': 1774475266.514363, 'last_price_update_time': 1774475266.514373, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982513') HTTP/1.1" 204 0
2026-03-25 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b6af5d0>
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F30dbf286619944d696f046d8d2955766%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/3.jpg saved to cache
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-25 21:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a, skipping ID generation
2026-03-25 21:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with scrape type 1
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a sending to next pipeline
2026-03-25 21:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a, identifier: 1982515
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69c090>
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/1.jpg saved to cache
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f812b69e890>
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F0519b920ebee46098b7bf5cab30add73%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/5.jpg saved to cache
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-25 21:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, skipping ID generation
2026-03-25 21:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-25 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 sending to next pipeline
2026-03-25 21:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, identifier: 1982516
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130395110>
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg HTTP/1.1" 201 0
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/6.jpg saved to cache
2026-03-25 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132507690>
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/8.jpg saved to cache
2026-03-25 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130b416d0>
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg HTTP/1.1" 201 0
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/2.jpg saved to cache
2026-03-25 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1982515
2026-03-25 21:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1982515
2026-03-25 21:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1982515 to the API
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee4b8be7-2931-55e9-9fa1-3da8ca2f764a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2er Gran Coupe',
 'odometer': 119189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 886526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/30dbf286619944d696f046d8d2955766/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er Gran Coupe BMW 216d Gran Coupe  Aut. Advantage Coupe, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 216d Gran Coupe  Aut. Advantage Coupe, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982515%27 HTTP/1.1" 200 None
2026-03-25 21:47:47 [ayvens.de] INFO: Saving data for 1982515: {'created_time': 1774475267.609775, 'last_price_update_time': 1774475267.609785, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982515') HTTP/1.1" 204 0
2026-03-25 21:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1982516
2026-03-25 21:47:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1982516
2026-03-25 21:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1982516 to the API
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '4.4L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '0eeff5ae-b901-5eac-a750-7d7ed9e326e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover',
 'odometer': 114452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/0519b920ebee46098b7bf5cab30add73/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover LAND ROVER Range Rover 4.4 SDV8 Vogue '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover 4.4 SDV8 Vogue Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982516%27 HTTP/1.1" 200 None
2026-03-25 21:47:47 [ayvens.de] INFO: Saving data for 1982516: {'created_time': 1774475267.96239, 'last_price_update_time': 1774475267.9624, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982516') HTTP/1.1" 204 0
2026-03-25 21:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130cf8250>
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg HTTP/1.1" 201 0
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F5718b35dfc914977b06491fc20320ccf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/1.jpg saved to cache
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-25 21:47:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67a42d01-bd07-5f99-a038-a43f584794fa, skipping ID generation
2026-03-25 21:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67a42d01-bd07-5f99-a038-a43f584794fa sending to next pipeline
2026-03-25 21:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 67a42d01-bd07-5f99-a038-a43f584794fa, identifier: 1982512
2026-03-25 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1982512
2026-03-25 21:47:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1982512
2026-03-25 21:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1982512 to the API
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '67a42d01-bd07-5f99-a038-a43f584794fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Arteon',
 'odometer': 120756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/5718b35dfc914977b06491fc20320ccf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Arteon VW Arteon Shooting Brake 1.4 eHybrid OPF DSG '
          'R-Line Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Arteon Shooting Brake 1.4 eHybrid OPF DSG R-Line Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982512%27 HTTP/1.1" 200 None
2026-03-25 21:47:48 [ayvens.de] INFO: Saving data for 1982512: {'created_time': 1774475268.494076, 'last_price_update_time': 1774475268.494086, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982512') HTTP/1.1" 204 0
2026-03-25 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130fb17d0>
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/10.jpg saved to cache
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8130896390>
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/8.jpg saved to cache
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81303b5f10>
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/9.jpg saved to cache
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8132a1bcd0>
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F871ec62c6884467bad4ba388772e748b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/7.jpg saved to cache
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-25 21:47:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a, skipping ID generation
2026-03-25 21:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with scrape type 1
2026-03-25 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a sending to next pipeline
2026-03-25 21:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a, identifier: 1982511
2026-03-25 21:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1982511
2026-03-25 21:47:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 21:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1982511
2026-03-25 21:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1982511 to the API
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 21:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '63c26d8c-f4b7-50ce-a6c0-4a69090c571a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41017',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Discovery Sport',
 'odometer': 116378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/871ec62c6884467bad4ba388772e748b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Discovery Sport LAND ROVER Discovery Sport D150 SE '
          'Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Discovery Sport D150 SE Geschlossen, 5-türig, Automatik, '
         '9-Gang',
 'vin': None,
 'year': 2019}
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271982511%27 HTTP/1.1" 200 None
2026-03-25 21:47:49 [ayvens.de] INFO: Saving data for 1982511: {'created_time': 1774475269.431912, 'last_price_update_time': 1774475269.431923, 'auction_closing_time': 1774533600.0}
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1982511') HTTP/1.1" 204 0
2026-03-25 21:47:49 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 21:47:49 [ayvens.de] INFO: ayvens.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 6, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20last_price_update_time%20lt%201774043269 HTTP/1.1" 200 None
2026-03-25 21:47:49 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (83 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.de/task_43_2026-03-25T21_45_00.jl
2026-03-25 21:47:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 387053,
 'downloader/request_count': 833,
 'downloader/request_method_count/GET': 831,
 'downloader/request_method_count/POST': 2,
 'downloader/response_bytes': 593396438,
 'downloader/response_count': 833,
 'downloader/response_status_count/200': 833,
 'elapsed_time_seconds': 162.955545,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 25, 21, 47, 49, 561314, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 83,
 'log_count/DEBUG': 6958,
 'log_count/INFO': 6985,
 'memusage/max': 194215936,
 'memusage/startup': 149884928,
 'photo_download_count': 830,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 129,
 'playwright/request_count/aborted': 12,
 'playwright/request_count/method/GET': 125,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 24,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 116,
 'playwright/response_count/method/GET': 113,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 12,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 2,
 'response_received_count': 3,
 'scheduler/dequeued': 833,
 'scheduler/dequeued/memory': 833,
 'scheduler/enqueued': 833,
 'scheduler/enqueued/memory': 833,
 'scrape_type/new': 83,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 2,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 1.9322431292384863,
 'scrapy-zyte-api/mean_response_seconds': 1.9933430086821318,
 'scrapy-zyte-api/processed': 2,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 2,
 'scrapy-zyte-api/request_args/httpRequestBody': 2,
 'scrapy-zyte-api/request_args/httpRequestMethod': 2,
 'scrapy-zyte-api/request_args/httpResponseBody': 2,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
 'scrapy-zyte-api/request_args/url': 2,
 'scrapy-zyte-api/status_codes/200': 2,
 'scrapy-zyte-api/success': 2,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 25, 21, 45, 6, 605769, tzinfo=datetime.timezone.utc)}
2026-03-25 21:47:49 [scrapy.core.engine] INFO: Spider closed (finished)