2026-03-29 02:45:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 02:45:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 02:45:05 [ayvens.de] INFO: Starting spider ayvens.de
2026-03-29 02:45:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 02:45:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 02:45:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 02:45:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 02:45:05 [scrapy.extensions.telnet] INFO: Telnet Password: c0ef94d1e8f15fa7
2026-03-29 02:45:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 02:45:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.de/task_43_2026-03-29T02_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 02:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 02:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 02:45:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 02:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 02:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 02:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 02:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 02:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-29 02:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 02:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 02:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-29 02:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-29 02:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 02:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 02:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 02:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 02:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 02:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 02:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 02:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 02:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 02:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 02:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-29 02:45:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-29 02:45:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-29 02:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-29 02:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-29 02:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-29 02:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-29 02:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-29 02:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-29 02:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-29 02:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-29 02:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-29 02:45:17 [ayvens.de] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'VHBLK73XG3GII/c5b7aJ0h|2026-03-29T02:45:16.044Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806288316, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'H/Zi03qdpTjCcbJid4LJvH|1774752317414|1774752317414', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774754117, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-29 02:45:17 [ayvens.de] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'VHBLK73XG3GII/c5b7aJ0h|2026-03-29T02:45:16.044Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'H/Zi03qdpTjCcbJid4LJvH|1774752317414|1774752317414', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-29 02:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-29 02:45:17 [ayvens.de] INFO: Intercepting token...
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-29 02:45:17 [ayvens.de] INFO: Scrolling element to trigger lazy load...
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:17 [ayvens.de] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-29 02:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-29 02:45:19 [ayvens.de] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-29 02:45:19 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-29 02:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 02:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-29 02:45:25 [ayvens.de] INFO: Found listing with ID: 1987779
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987779%27 HTTP/1.1" 200 None
2026-03-29 02:45:25 [ayvens.de] INFO: Scrape type for 1987779: 2
2026-03-29 02:45:25 [ayvens.de] INFO: Extracting data for car ID: 1987779
2026-03-29 02:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779
2026-03-29 02:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33ffe25-53ed-5144-837e-f7bdbecc4a33 with scrape type 2
2026-03-29 02:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b33ffe25-53ed-5144-837e-f7bdbecc4a33 with scrape type 2
2026-03-29 02:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b33ffe25-53ed-5144-837e-f7bdbecc4a33, identifier: 1987779
2026-03-29 02:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779
2026-03-29 02:45:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779
2026-03-29 02:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779 to the API
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b33ffe25-53ed-5144-837e-f7bdbecc4a33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 45816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 INTENS Limousine, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 INTENS Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987779%27 HTTP/1.1" 200 None
2026-03-29 02:45:25 [ayvens.de] INFO: Saving data for 1987779: {'auction_closing_time': 1774875600.0, 'created_time': 1774647927.223909, 'last_price_update_time': 1774752325.857226}
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987779') HTTP/1.1" 204 0
2026-03-29 02:45:25 [ayvens.de] INFO: Found listing with ID: 1987780
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987780%27 HTTP/1.1" 200 None
2026-03-29 02:45:25 [ayvens.de] INFO: Scrape type for 1987780: 2
2026-03-29 02:45:25 [ayvens.de] INFO: Extracting data for car ID: 1987780
2026-03-29 02:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780
2026-03-29 02:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with scrape type 2
2026-03-29 02:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with scrape type 2
2026-03-29 02:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac, identifier: 1987780
2026-03-29 02:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780
2026-03-29 02:45:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780
2026-03-29 02:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780 to the API
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'ca7d7f96-98ba-53e1-81d8-44e2f0b093ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 180623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987780%27 HTTP/1.1" 200 None
2026-03-29 02:45:26 [ayvens.de] INFO: Saving data for 1987780: {'auction_closing_time': 1774875600.0, 'created_time': 1774648084.687041, 'last_price_update_time': 1774752326.573833}
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987780') HTTP/1.1" 204 0
2026-03-29 02:45:26 [ayvens.de] INFO: Found listing with ID: 1987781
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987781%27 HTTP/1.1" 200 None
2026-03-29 02:45:26 [ayvens.de] INFO: Scrape type for 1987781: 2
2026-03-29 02:45:26 [ayvens.de] INFO: Extracting data for car ID: 1987781
2026-03-29 02:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781
2026-03-29 02:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 2
2026-03-29 02:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 2
2026-03-29 02:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 67a42d01-bd07-5f99-a038-a43f584794fa, identifier: 1987781
2026-03-29 02:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781
2026-03-29 02:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781
2026-03-29 02:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781 to the API
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '67a42d01-bd07-5f99-a038-a43f584794fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Arteon',
 'odometer': 120756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Arteon VW Arteon Shooting Brake 1.4 eHybrid OPF DSG '
          'R-Line Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Arteon Shooting Brake 1.4 eHybrid OPF DSG R-Line Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987781%27 HTTP/1.1" 200 None
2026-03-29 02:45:26 [ayvens.de] INFO: Saving data for 1987781: {'auction_closing_time': 1774875600.0, 'created_time': 1774648083.387665, 'last_price_update_time': 1774752326.986087}
2026-03-29 02:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987781') HTTP/1.1" 204 0
2026-03-29 02:45:27 [ayvens.de] INFO: Found listing with ID: 1987782
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987782%27 HTTP/1.1" 200 None
2026-03-29 02:45:27 [ayvens.de] INFO: Scrape type for 1987782: 2
2026-03-29 02:45:27 [ayvens.de] INFO: Extracting data for car ID: 1987782
2026-03-29 02:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782
2026-03-29 02:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 2
2026-03-29 02:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 2
2026-03-29 02:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d72b9397-852a-5550-89f5-edd56a131f9a, identifier: 1987782
2026-03-29 02:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782
2026-03-29 02:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782
2026-03-29 02:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782 to the API
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd72b9397-852a-5550-89f5-edd56a131f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Discovery Sport',
 'odometer': 64253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Discovery Sport LAND ROVER Discovery Sport P300e '
          'R-Dynamic S Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Discovery Sport P300e R-Dynamic S Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987782%27 HTTP/1.1" 200 None
2026-03-29 02:45:27 [ayvens.de] INFO: Saving data for 1987782: {'auction_closing_time': 1774875600.0, 'created_time': 1774648083.717738, 'last_price_update_time': 1774752327.401065}
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987782') HTTP/1.1" 204 0
2026-03-29 02:45:27 [ayvens.de] INFO: Found listing with ID: 1987783
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987783%27 HTTP/1.1" 200 None
2026-03-29 02:45:27 [ayvens.de] INFO: Scrape type for 1987783: 2
2026-03-29 02:45:27 [ayvens.de] INFO: Extracting data for car ID: 1987783
2026-03-29 02:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783
2026-03-29 02:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with scrape type 2
2026-03-29 02:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with scrape type 2
2026-03-29 02:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 23da542c-9ccf-5b25-951c-f9c7499dd8a7, identifier: 1987783
2026-03-29 02:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783
2026-03-29 02:45:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783
2026-03-29 02:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783 to the API
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Braun',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '23da542c-9ccf-5b25-951c-f9c7499dd8a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Defender',
 'odometer': 84688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Defender LAND ROVER Defender 110 P400e X-Dynamic HSE '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Defender 110 P400e X-Dynamic HSE Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987783%27 HTTP/1.1" 200 None
2026-03-29 02:45:27 [ayvens.de] INFO: Saving data for 1987783: {'auction_closing_time': 1774875600.0, 'created_time': 1774648081.0754, 'last_price_update_time': 1774752327.830388}
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987783') HTTP/1.1" 204 0
2026-03-29 02:45:27 [ayvens.de] INFO: Found listing with ID: 1987784
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987784%27 HTTP/1.1" 200 None
2026-03-29 02:45:27 [ayvens.de] INFO: Scrape type for 1987784: 2
2026-03-29 02:45:27 [ayvens.de] INFO: Extracting data for car ID: 1987784
2026-03-29 02:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784
2026-03-29 02:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 2
2026-03-29 02:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 2
2026-03-29 02:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, identifier: 1987784
2026-03-29 02:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784
2026-03-29 02:45:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784
2026-03-29 02:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784 to the API
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '4.4L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0eeff5ae-b901-5eac-a750-7d7ed9e326e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover',
 'odometer': 114452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover LAND ROVER Range Rover 4.4 SDV8 Vogue '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover 4.4 SDV8 Vogue Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987784%27 HTTP/1.1" 200 None
2026-03-29 02:45:28 [ayvens.de] INFO: Saving data for 1987784: {'auction_closing_time': 1774875600.0, 'created_time': 1774648081.449529, 'last_price_update_time': 1774752328.576873}
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987784') HTTP/1.1" 204 0
2026-03-29 02:45:28 [ayvens.de] INFO: Found listing with ID: 1987785
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987785%27 HTTP/1.1" 200 None
2026-03-29 02:45:28 [ayvens.de] INFO: Scrape type for 1987785: 2
2026-03-29 02:45:28 [ayvens.de] INFO: Extracting data for car ID: 1987785
2026-03-29 02:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785
2026-03-29 02:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 2
2026-03-29 02:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 2
2026-03-29 02:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6209d459-4198-5691-9aab-360956f8f4d6, identifier: 1987785
2026-03-29 02:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785
2026-03-29 02:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785
2026-03-29 02:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785 to the API
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '6209d459-4198-5691-9aab-360956f8f4d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Vito / Marco Polo',
 'odometer': 107057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Vito / Marco Polo MERCEDES-BENZ Vito 114 CDI Lang HA '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ Vito 114 CDI Lang HA Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987785%27 HTTP/1.1" 200 None
2026-03-29 02:45:28 [ayvens.de] INFO: Saving data for 1987785: {'auction_closing_time': 1774875600.0, 'created_time': 1774647933.530477, 'last_price_update_time': 1774752328.985437}
2026-03-29 02:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987785') HTTP/1.1" 204 0
2026-03-29 02:45:29 [ayvens.de] INFO: Found listing with ID: 1987786
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987786%27 HTTP/1.1" 200 None
2026-03-29 02:45:29 [ayvens.de] INFO: Scrape type for 1987786: 2
2026-03-29 02:45:29 [ayvens.de] INFO: Extracting data for car ID: 1987786
2026-03-29 02:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786
2026-03-29 02:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601aefa2-34f9-5f82-b859-a7a20821655f with scrape type 2
2026-03-29 02:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601aefa2-34f9-5f82-b859-a7a20821655f with scrape type 2
2026-03-29 02:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 601aefa2-34f9-5f82-b859-a7a20821655f, identifier: 1987786
2026-03-29 02:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786
2026-03-29 02:45:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786
2026-03-29 02:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786 to the API
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '601aefa2-34f9-5f82-b859-a7a20821655f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 90928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'TITANIUM Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. TITANIUM '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987786%27 HTTP/1.1" 200 None
2026-03-29 02:45:29 [ayvens.de] INFO: Saving data for 1987786: {'auction_closing_time': 1774875600.0, 'created_time': 1774648082.06987, 'last_price_update_time': 1774752329.395669}
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987786') HTTP/1.1" 204 0
2026-03-29 02:45:29 [ayvens.de] INFO: Found listing with ID: 1987787
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987787%27 HTTP/1.1" 200 None
2026-03-29 02:45:29 [ayvens.de] INFO: Scrape type for 1987787: 2
2026-03-29 02:45:29 [ayvens.de] INFO: Extracting data for car ID: 1987787
2026-03-29 02:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787
2026-03-29 02:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 with scrape type 2
2026-03-29 02:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 with scrape type 2
2026-03-29 02:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 18ff01f4-8956-544e-ada0-27e1ec8ed875, identifier: 1987787
2026-03-29 02:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787
2026-03-29 02:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787
2026-03-29 02:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787 to the API
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '18ff01f4-8956-544e-ada0-27e1ec8ed875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Galaxy',
 'odometer': 126506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD Galaxy FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987787%27 HTTP/1.1" 200 None
2026-03-29 02:45:29 [ayvens.de] INFO: Saving data for 1987787: {'auction_closing_time': 1774875600.0, 'created_time': 1774647936.401469, 'last_price_update_time': 1774752329.847801}
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987787') HTTP/1.1" 204 0
2026-03-29 02:45:29 [ayvens.de] INFO: Found listing with ID: 1987788
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987788%27 HTTP/1.1" 200 None
2026-03-29 02:45:29 [ayvens.de] INFO: Scrape type for 1987788: 2
2026-03-29 02:45:29 [ayvens.de] INFO: Extracting data for car ID: 1987788
2026-03-29 02:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788
2026-03-29 02:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with scrape type 2
2026-03-29 02:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with scrape type 2
2026-03-29 02:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9, identifier: 1987788
2026-03-29 02:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788
2026-03-29 02:45:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788
2026-03-29 02:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788 to the API
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Metropolis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '11eb9a57-536b-59ae-a3f4-dc61ae7566c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 80530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'ST-LINE Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. ST-LINE '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987788%27 HTTP/1.1" 200 None
2026-03-29 02:45:30 [ayvens.de] INFO: Saving data for 1987788: {'auction_closing_time': 1774875600.0, 'created_time': 1774648079.504567, 'last_price_update_time': 1774752330.276072}
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987788') HTTP/1.1" 204 0
2026-03-29 02:45:30 [ayvens.de] INFO: Found listing with ID: 1987789
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987789%27 HTTP/1.1" 200 None
2026-03-29 02:45:30 [ayvens.de] INFO: Scrape type for 1987789: 2
2026-03-29 02:45:30 [ayvens.de] INFO: Extracting data for car ID: 1987789
2026-03-29 02:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789
2026-03-29 02:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with scrape type 2
2026-03-29 02:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with scrape type 2
2026-03-29 02:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9, identifier: 1987789
2026-03-29 02:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789
2026-03-29 02:45:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789
2026-03-29 02:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789 to the API
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8fb06ed8-bbf9-507e-90ef-0846b8eca4e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 112803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System '
          'COOL&CONNECT Kombi, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System COOL&CONNECT '
         'Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987789%27 HTTP/1.1" 200 None
2026-03-29 02:45:30 [ayvens.de] INFO: Saving data for 1987789: {'auction_closing_time': 1774875600.0, 'created_time': 1774648078.548224, 'last_price_update_time': 1774752330.690765}
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987789') HTTP/1.1" 204 0
2026-03-29 02:45:30 [ayvens.de] INFO: Found listing with ID: 1987790
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987790%27 HTTP/1.1" 200 None
2026-03-29 02:45:30 [ayvens.de] INFO: Scrape type for 1987790: 2
2026-03-29 02:45:30 [ayvens.de] INFO: Extracting data for car ID: 1987790
2026-03-29 02:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790
2026-03-29 02:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc40d71-74f4-5f23-bae5-672a480991f4 with scrape type 2
2026-03-29 02:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbc40d71-74f4-5f23-bae5-672a480991f4 with scrape type 2
2026-03-29 02:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: dbc40d71-74f4-5f23-bae5-672a480991f4, identifier: 1987790
2026-03-29 02:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790
2026-03-29 02:45:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790
2026-03-29 02:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790 to the API
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbc40d71-74f4-5f23-bae5-672a480991f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 119632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'COOL&CONNECT Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. COOL&CONNECT '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987790%27 HTTP/1.1" 200 None
2026-03-29 02:45:31 [ayvens.de] INFO: Saving data for 1987790: {'auction_closing_time': 1774875600.0, 'created_time': 1774648077.923844, 'last_price_update_time': 1774752331.333796}
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987790') HTTP/1.1" 204 0
2026-03-29 02:45:31 [ayvens.de] INFO: Found listing with ID: 1987791
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987791%27 HTTP/1.1" 200 None
2026-03-29 02:45:31 [ayvens.de] INFO: Scrape type for 1987791: 2
2026-03-29 02:45:31 [ayvens.de] INFO: Extracting data for car ID: 1987791
2026-03-29 02:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791
2026-03-29 02:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29b5c194-188c-50fc-9a0d-643cdcecce33 with scrape type 2
2026-03-29 02:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29b5c194-188c-50fc-9a0d-643cdcecce33 with scrape type 2
2026-03-29 02:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 29b5c194-188c-50fc-9a0d-643cdcecce33, identifier: 1987791
2026-03-29 02:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791
2026-03-29 02:45:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791
2026-03-29 02:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791 to the API
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '29b5c194-188c-50fc-9a0d-643cdcecce33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 40474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987791%27 HTTP/1.1" 200 None
2026-03-29 02:45:31 [ayvens.de] INFO: Saving data for 1987791: {'auction_closing_time': 1774875600.0, 'created_time': 1774648072.146151, 'last_price_update_time': 1774752331.7998}
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987791') HTTP/1.1" 204 0
2026-03-29 02:45:31 [ayvens.de] INFO: Found listing with ID: 1987792
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987792%27 HTTP/1.1" 200 None
2026-03-29 02:45:31 [ayvens.de] INFO: Scrape type for 1987792: 2
2026-03-29 02:45:31 [ayvens.de] INFO: Extracting data for car ID: 1987792
2026-03-29 02:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792
2026-03-29 02:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c482979-bb1e-5dac-9b73-7dcb854faea9 with scrape type 2
2026-03-29 02:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c482979-bb1e-5dac-9b73-7dcb854faea9 with scrape type 2
2026-03-29 02:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 7c482979-bb1e-5dac-9b73-7dcb854faea9, identifier: 1987792
2026-03-29 02:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792
2026-03-29 02:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792
2026-03-29 02:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792 to the API
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c482979-bb1e-5dac-9b73-7dcb854faea9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mondeo',
 'odometer': 264554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mondeo FORD Mondeo Turnier 2.0 EcoBlue Aut. ST-Line Kombi, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Mondeo Turnier 2.0 EcoBlue Aut. ST-Line Kombi, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987792%27 HTTP/1.1" 200 None
2026-03-29 02:45:32 [ayvens.de] INFO: Saving data for 1987792: {'auction_closing_time': 1774875600.0, 'created_time': 1774648075.544018, 'last_price_update_time': 1774752332.196776}
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987792') HTTP/1.1" 204 0
2026-03-29 02:45:32 [ayvens.de] INFO: Found listing with ID: 1987793
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987793%27 HTTP/1.1" 200 None
2026-03-29 02:45:32 [ayvens.de] INFO: Scrape type for 1987793: 2
2026-03-29 02:45:32 [ayvens.de] INFO: Extracting data for car ID: 1987793
2026-03-29 02:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793
2026-03-29 02:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with scrape type 2
2026-03-29 02:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with scrape type 2
2026-03-29 02:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb, identifier: 1987793
2026-03-29 02:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793
2026-03-29 02:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793
2026-03-29 02:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793 to the API
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2c42f555-a9a2-582b-ae9f-39b4dbc419cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-Max',
 'odometer': 125194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD S-Max FORD S-Max 2.0 EcoBlue Aut. TITANIUM Kombi, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD S-Max 2.0 EcoBlue Aut. TITANIUM Kombi, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987793%27 HTTP/1.1" 200 None
2026-03-29 02:45:32 [ayvens.de] INFO: Saving data for 1987793: {'auction_closing_time': 1774875600.0, 'created_time': 1774648074.805761, 'last_price_update_time': 1774752332.597976}
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987793') HTTP/1.1" 204 0
2026-03-29 02:45:32 [ayvens.de] INFO: Found listing with ID: 1987794
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987794%27 HTTP/1.1" 200 None
2026-03-29 02:45:32 [ayvens.de] INFO: Scrape type for 1987794: 2
2026-03-29 02:45:32 [ayvens.de] INFO: Extracting data for car ID: 1987794
2026-03-29 02:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794
2026-03-29 02:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with scrape type 2
2026-03-29 02:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with scrape type 2
2026-03-29 02:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 21e9ba47-e1c0-50a1-b9e3-e74991c60147, identifier: 1987794
2026-03-29 02:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794
2026-03-29 02:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794
2026-03-29 02:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794 to the API
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '21e9ba47-e1c0-50a1-b9e3-e74991c60147',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Tourneo Custom',
 'odometer': 153086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 8,
 'seller_name': None,
 'title': 'FORD Tourneo Custom FORD Tourneo Custom 320 L2H1 VA Autm. Active '
          'Bus, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Tourneo Custom 320 L2H1 VA Autm. Active Bus, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987794%27 HTTP/1.1" 200 None
2026-03-29 02:45:32 [ayvens.de] INFO: Saving data for 1987794: {'auction_closing_time': 1774875600.0, 'created_time': 1774648074.407991, 'last_price_update_time': 1774752332.998125}
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987794') HTTP/1.1" 204 0
2026-03-29 02:45:33 [ayvens.de] INFO: Found listing with ID: 1987795
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987795%27 HTTP/1.1" 200 None
2026-03-29 02:45:33 [ayvens.de] INFO: Scrape type for 1987795: 2
2026-03-29 02:45:33 [ayvens.de] INFO: Extracting data for car ID: 1987795
2026-03-29 02:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795
2026-03-29 02:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b932a82-f05b-5690-a011-893c32e01134 with scrape type 2
2026-03-29 02:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b932a82-f05b-5690-a011-893c32e01134 with scrape type 2
2026-03-29 02:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 7b932a82-f05b-5690-a011-893c32e01134, identifier: 1987795
2026-03-29 02:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795
2026-03-29 02:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795
2026-03-29 02:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795 to the API
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b932a82-f05b-5690-a011-893c32e01134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Custom',
 'odometer': 116223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit Custom FORD Transit Custom 340 L1H2 LKW VA Trend '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Custom 340 L1H2 LKW VA Trend Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987795%27 HTTP/1.1" 200 None
2026-03-29 02:45:33 [ayvens.de] INFO: Saving data for 1987795: {'auction_closing_time': 1774875600.0, 'created_time': 1774648075.179054, 'last_price_update_time': 1774752333.383953}
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987795') HTTP/1.1" 204 0
2026-03-29 02:45:33 [ayvens.de] INFO: Found listing with ID: 1987796
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987796%27 HTTP/1.1" 200 None
2026-03-29 02:45:33 [ayvens.de] INFO: Scrape type for 1987796: 2
2026-03-29 02:45:33 [ayvens.de] INFO: Extracting data for car ID: 1987796
2026-03-29 02:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796
2026-03-29 02:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1113849-b627-5942-8c72-b9129bb2ed46 with scrape type 2
2026-03-29 02:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1113849-b627-5942-8c72-b9129bb2ed46 with scrape type 2
2026-03-29 02:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d1113849-b627-5942-8c72-b9129bb2ed46, identifier: 1987796
2026-03-29 02:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796
2026-03-29 02:45:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796
2026-03-29 02:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796 to the API
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'd1113849-b627-5942-8c72-b9129bb2ed46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 153804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987796%27 HTTP/1.1" 200 None
2026-03-29 02:45:33 [ayvens.de] INFO: Saving data for 1987796: {'auction_closing_time': 1774875600.0, 'created_time': 1774648071.461795, 'last_price_update_time': 1774752333.858602}
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987796') HTTP/1.1" 204 0
2026-03-29 02:45:33 [ayvens.de] INFO: Found listing with ID: 1987797
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987797%27 HTTP/1.1" 200 None
2026-03-29 02:45:33 [ayvens.de] INFO: Scrape type for 1987797: 2
2026-03-29 02:45:33 [ayvens.de] INFO: Extracting data for car ID: 1987797
2026-03-29 02:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797
2026-03-29 02:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5536894-1852-55b1-99dd-4372c9a005f1 with scrape type 2
2026-03-29 02:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5536894-1852-55b1-99dd-4372c9a005f1 with scrape type 2
2026-03-29 02:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: c5536894-1852-55b1-99dd-4372c9a005f1, identifier: 1987797
2026-03-29 02:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797
2026-03-29 02:45:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797
2026-03-29 02:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797 to the API
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c5536894-1852-55b1-99dd-4372c9a005f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 19368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse MERCEDES-BENZ A 250 e 8G-DCT AMG Line '
          'Limousine, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ A 250 e 8G-DCT AMG Line Limousine, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987797%27 HTTP/1.1" 200 None
2026-03-29 02:45:34 [ayvens.de] INFO: Saving data for 1987797: {'auction_closing_time': 1774875600.0, 'created_time': 1774648069.236289, 'last_price_update_time': 1774752334.270697}
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987797') HTTP/1.1" 204 0
2026-03-29 02:45:34 [ayvens.de] INFO: Found listing with ID: 1987798
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987798%27 HTTP/1.1" 200 None
2026-03-29 02:45:34 [ayvens.de] INFO: Scrape type for 1987798: 2
2026-03-29 02:45:34 [ayvens.de] INFO: Extracting data for car ID: 1987798
2026-03-29 02:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798
2026-03-29 02:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be174198-dc82-584e-96c3-b82d1b969eee with scrape type 2
2026-03-29 02:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be174198-dc82-584e-96c3-b82d1b969eee with scrape type 2
2026-03-29 02:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: be174198-dc82-584e-96c3-b82d1b969eee, identifier: 1987798
2026-03-29 02:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798
2026-03-29 02:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798
2026-03-29 02:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798 to the API
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'be174198-dc82-584e-96c3-b82d1b969eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 70856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE X '
          'Kombi, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE X Kombi, '
         '5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987798%27 HTTP/1.1" 200 None
2026-03-29 02:45:34 [ayvens.de] INFO: Saving data for 1987798: {'auction_closing_time': 1774875600.0, 'created_time': 1774647948.82813, 'last_price_update_time': 1774752334.683322}
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987798') HTTP/1.1" 204 0
2026-03-29 02:45:34 [ayvens.de] INFO: Found listing with ID: 1987799
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987799%27 HTTP/1.1" 200 None
2026-03-29 02:45:34 [ayvens.de] INFO: Scrape type for 1987799: 2
2026-03-29 02:45:34 [ayvens.de] INFO: Extracting data for car ID: 1987799
2026-03-29 02:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799
2026-03-29 02:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acad9b67-2e5f-5e43-a57e-f3735af501a4 with scrape type 2
2026-03-29 02:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acad9b67-2e5f-5e43-a57e-f3735af501a4 with scrape type 2
2026-03-29 02:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: acad9b67-2e5f-5e43-a57e-f3735af501a4, identifier: 1987799
2026-03-29 02:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799
2026-03-29 02:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799
2026-03-29 02:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799 to the API
2026-03-29 02:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'acad9b67-2e5f-5e43-a57e-f3735af501a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 123351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987799%27 HTTP/1.1" 200 None
2026-03-29 02:45:35 [ayvens.de] INFO: Saving data for 1987799: {'auction_closing_time': 1774875600.0, 'created_time': 1774648070.786586, 'last_price_update_time': 1774752335.182287}
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987799') HTTP/1.1" 204 0
2026-03-29 02:45:35 [ayvens.de] INFO: Found listing with ID: 1987800
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987800%27 HTTP/1.1" 200 None
2026-03-29 02:45:35 [ayvens.de] INFO: Scrape type for 1987800: 2
2026-03-29 02:45:35 [ayvens.de] INFO: Extracting data for car ID: 1987800
2026-03-29 02:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800
2026-03-29 02:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b721d2-b05a-57f4-83b8-c11a53a63f77 with scrape type 2
2026-03-29 02:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88b721d2-b05a-57f4-83b8-c11a53a63f77 with scrape type 2
2026-03-29 02:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 88b721d2-b05a-57f4-83b8-c11a53a63f77, identifier: 1987800
2026-03-29 02:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800
2026-03-29 02:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800
2026-03-29 02:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800 to the API
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '88b721d2-b05a-57f4-83b8-c11a53a63f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 106141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'COOL&CONNECT Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. COOL&CONNECT '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987800%27 HTTP/1.1" 200 None
2026-03-29 02:45:35 [ayvens.de] INFO: Saving data for 1987800: {'auction_closing_time': 1774875600.0, 'created_time': 1774648070.416924, 'last_price_update_time': 1774752335.593307}
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987800') HTTP/1.1" 204 0
2026-03-29 02:45:35 [ayvens.de] INFO: Found listing with ID: 1987801
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987801%27 HTTP/1.1" 200 None
2026-03-29 02:45:35 [ayvens.de] INFO: Scrape type for 1987801: 2
2026-03-29 02:45:35 [ayvens.de] INFO: Extracting data for car ID: 1987801
2026-03-29 02:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801
2026-03-29 02:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8024555-6b9c-542b-8625-3da326403b1a with scrape type 2
2026-03-29 02:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8024555-6b9c-542b-8625-3da326403b1a with scrape type 2
2026-03-29 02:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f8024555-6b9c-542b-8625-3da326403b1a, identifier: 1987801
2026-03-29 02:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801
2026-03-29 02:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801
2026-03-29 02:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801 to the API
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f8024555-6b9c-542b-8625-3da326403b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 40431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987801%27 HTTP/1.1" 200 None
2026-03-29 02:45:36 [ayvens.de] INFO: Saving data for 1987801: {'auction_closing_time': 1774875600.0, 'created_time': 1774647952.468924, 'last_price_update_time': 1774752336.090861}
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987801') HTTP/1.1" 204 0
2026-03-29 02:45:36 [ayvens.de] INFO: Found listing with ID: 1987802
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987802%27 HTTP/1.1" 200 None
2026-03-29 02:45:36 [ayvens.de] INFO: Scrape type for 1987802: 2
2026-03-29 02:45:36 [ayvens.de] INFO: Extracting data for car ID: 1987802
2026-03-29 02:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802
2026-03-29 02:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b11edacd-abea-5948-aafb-0743e15f910b with scrape type 2
2026-03-29 02:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b11edacd-abea-5948-aafb-0743e15f910b with scrape type 2
2026-03-29 02:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b11edacd-abea-5948-aafb-0743e15f910b, identifier: 1987802
2026-03-29 02:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802
2026-03-29 02:45:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802
2026-03-29 02:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802 to the API
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Absolute Black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b11edacd-abea-5948-aafb-0743e15f910b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 21210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E PREMIUM Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E PREMIUM Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987802%27 HTTP/1.1" 200 None
2026-03-29 02:45:36 [ayvens.de] INFO: Saving data for 1987802: {'auction_closing_time': 1774875600.0, 'created_time': 1774647954.017982, 'last_price_update_time': 1774752336.508718}
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987802') HTTP/1.1" 204 0
2026-03-29 02:45:36 [ayvens.de] INFO: Found listing with ID: 1987803
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987803%27 HTTP/1.1" 200 None
2026-03-29 02:45:36 [ayvens.de] INFO: Scrape type for 1987803: 2
2026-03-29 02:45:36 [ayvens.de] INFO: Extracting data for car ID: 1987803
2026-03-29 02:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803
2026-03-29 02:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with scrape type 2
2026-03-29 02:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with scrape type 2
2026-03-29 02:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9, identifier: 1987803
2026-03-29 02:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803
2026-03-29 02:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803
2026-03-29 02:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803 to the API
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '2c9b06da-843a-5d1f-9c44-a9b838e2f5c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 68108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.0 EcoBoost Hybrid Aut. ST-LINE Geschlossen, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Puma 1.0 EcoBoost Hybrid Aut. ST-LINE Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987803%27 HTTP/1.1" 200 None
2026-03-29 02:45:36 [ayvens.de] INFO: Saving data for 1987803: {'auction_closing_time': 1774875600.0, 'created_time': 1774648071.143807, 'last_price_update_time': 1774752336.911612}
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987803') HTTP/1.1" 204 0
2026-03-29 02:45:36 [ayvens.de] INFO: Found listing with ID: 1987804
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987804%27 HTTP/1.1" 200 None
2026-03-29 02:45:36 [ayvens.de] INFO: Scrape type for 1987804: 2
2026-03-29 02:45:36 [ayvens.de] INFO: Extracting data for car ID: 1987804
2026-03-29 02:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804
2026-03-29 02:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with scrape type 2
2026-03-29 02:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with scrape type 2
2026-03-29 02:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 4bfdaee3-c918-523b-bb9e-9954ffeeff10, identifier: 1987804
2026-03-29 02:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804
2026-03-29 02:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804
2026-03-29 02:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804 to the API
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Braun',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4bfdaee3-c918-523b-bb9e-9954ffeeff10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 48543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Spirit '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Spirit Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987804%27 HTTP/1.1" 200 None
2026-03-29 02:45:37 [ayvens.de] INFO: Saving data for 1987804: {'auction_closing_time': 1774875600.0, 'created_time': 1774648068.399511, 'last_price_update_time': 1774752337.293637}
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987804') HTTP/1.1" 204 0
2026-03-29 02:45:37 [ayvens.de] INFO: Found listing with ID: 1987805
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987805%27 HTTP/1.1" 200 None
2026-03-29 02:45:37 [ayvens.de] INFO: Scrape type for 1987805: 2
2026-03-29 02:45:37 [ayvens.de] INFO: Extracting data for car ID: 1987805
2026-03-29 02:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805
2026-03-29 02:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 157ef602-4c35-5024-9168-76ec41d79bc9 with scrape type 2
2026-03-29 02:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 157ef602-4c35-5024-9168-76ec41d79bc9 with scrape type 2
2026-03-29 02:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 157ef602-4c35-5024-9168-76ec41d79bc9, identifier: 1987805
2026-03-29 02:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805
2026-03-29 02:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805
2026-03-29 02:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805 to the API
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '157ef602-4c35-5024-9168-76ec41d79bc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master III',
 'odometer': 9624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master III RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2018}
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987805%27 HTTP/1.1" 200 None
2026-03-29 02:45:37 [ayvens.de] INFO: Saving data for 1987805: {'auction_closing_time': 1774875600.0, 'created_time': 1774648067.379298, 'last_price_update_time': 1774752337.701979}
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987805') HTTP/1.1" 204 0
2026-03-29 02:45:37 [ayvens.de] INFO: Found listing with ID: 1987806
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987806%27 HTTP/1.1" 200 None
2026-03-29 02:45:37 [ayvens.de] INFO: Scrape type for 1987806: 2
2026-03-29 02:45:37 [ayvens.de] INFO: Extracting data for car ID: 1987806
2026-03-29 02:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806
2026-03-29 02:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6a67e7-7153-55d9-9602-e1b985887e85 with scrape type 2
2026-03-29 02:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef6a67e7-7153-55d9-9602-e1b985887e85 with scrape type 2
2026-03-29 02:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ef6a67e7-7153-55d9-9602-e1b985887e85, identifier: 1987806
2026-03-29 02:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806
2026-03-29 02:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806
2026-03-29 02:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806 to the API
2026-03-29 02:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef6a67e7-7153-55d9-9602-e1b985887e85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 186760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987806%27 HTTP/1.1" 200 None
2026-03-29 02:45:38 [ayvens.de] INFO: Saving data for 1987806: {'auction_closing_time': 1774875600.0, 'created_time': 1774647958.606917, 'last_price_update_time': 1774752338.131946}
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987806') HTTP/1.1" 204 0
2026-03-29 02:45:38 [ayvens.de] INFO: Found listing with ID: 1987807
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987807%27 HTTP/1.1" 200 None
2026-03-29 02:45:38 [ayvens.de] INFO: Scrape type for 1987807: 2
2026-03-29 02:45:38 [ayvens.de] INFO: Extracting data for car ID: 1987807
2026-03-29 02:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807
2026-03-29 02:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3827ca3-94ec-5f3f-996b-9f5971f76112 with scrape type 2
2026-03-29 02:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3827ca3-94ec-5f3f-996b-9f5971f76112 with scrape type 2
2026-03-29 02:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d3827ca3-94ec-5f3f-996b-9f5971f76112, identifier: 1987807
2026-03-29 02:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807
2026-03-29 02:45:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807
2026-03-29 02:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807 to the API
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'd3827ca3-94ec-5f3f-996b-9f5971f76112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1er',
 'odometer': 115495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er BMW 116i Limousine, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'BMW 116i Limousine, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987807%27 HTTP/1.1" 200 None
2026-03-29 02:45:38 [ayvens.de] INFO: Saving data for 1987807: {'auction_closing_time': 1774875600.0, 'created_time': 1774648067.00399, 'last_price_update_time': 1774752338.526993}
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987807') HTTP/1.1" 204 0
2026-03-29 02:45:38 [ayvens.de] INFO: Found listing with ID: 1987808
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987808%27 HTTP/1.1" 200 None
2026-03-29 02:45:38 [ayvens.de] INFO: Scrape type for 1987808: 2
2026-03-29 02:45:38 [ayvens.de] INFO: Extracting data for car ID: 1987808
2026-03-29 02:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808
2026-03-29 02:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a92b7d-d477-5d06-9cd1-1842a6e26441 with scrape type 2
2026-03-29 02:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a92b7d-d477-5d06-9cd1-1842a6e26441 with scrape type 2
2026-03-29 02:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 76a92b7d-d477-5d06-9cd1-1842a6e26441, identifier: 1987808
2026-03-29 02:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808
2026-03-29 02:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808
2026-03-29 02:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808 to the API
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '76a92b7d-d477-5d06-9cd1-1842a6e26441',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3er',
 'odometer': 53659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er BMW 318d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 318d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987808%27 HTTP/1.1" 200 None
2026-03-29 02:45:38 [ayvens.de] INFO: Saving data for 1987808: {'auction_closing_time': 1774875600.0, 'created_time': 1774647961.98315, 'last_price_update_time': 1774752338.924863}
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987808') HTTP/1.1" 204 0
2026-03-29 02:45:38 [ayvens.de] INFO: Found listing with ID: 1987809
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987809%27 HTTP/1.1" 200 None
2026-03-29 02:45:38 [ayvens.de] INFO: Scrape type for 1987809: 2
2026-03-29 02:45:38 [ayvens.de] INFO: Extracting data for car ID: 1987809
2026-03-29 02:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809
2026-03-29 02:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8184e333-f1fa-5d44-a229-8c9131a814c6 with scrape type 2
2026-03-29 02:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8184e333-f1fa-5d44-a229-8c9131a814c6 with scrape type 2
2026-03-29 02:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8184e333-f1fa-5d44-a229-8c9131a814c6, identifier: 1987809
2026-03-29 02:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809
2026-03-29 02:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809
2026-03-29 02:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809 to the API
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '8184e333-f1fa-5d44-a229-8c9131a814c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3er',
 'odometer': 109974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er BMW 330e Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 330e Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987809%27 HTTP/1.1" 200 None
2026-03-29 02:45:39 [ayvens.de] INFO: Saving data for 1987809: {'auction_closing_time': 1774875600.0, 'created_time': 1774648066.607309, 'last_price_update_time': 1774752339.325145}
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987809') HTTP/1.1" 204 0
2026-03-29 02:45:39 [ayvens.de] INFO: Found listing with ID: 1987810
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987810%27 HTTP/1.1" 200 None
2026-03-29 02:45:39 [ayvens.de] INFO: Scrape type for 1987810: 2
2026-03-29 02:45:39 [ayvens.de] INFO: Extracting data for car ID: 1987810
2026-03-29 02:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810
2026-03-29 02:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334db34a-12c0-541d-95e3-0b79ffa4ad57 with scrape type 2
2026-03-29 02:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 334db34a-12c0-541d-95e3-0b79ffa4ad57 with scrape type 2
2026-03-29 02:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 334db34a-12c0-541d-95e3-0b79ffa4ad57, identifier: 1987810
2026-03-29 02:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810
2026-03-29 02:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810
2026-03-29 02:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810 to the API
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '334db34a-12c0-541d-95e3-0b79ffa4ad57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5er',
 'odometer': 164852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er BMW 530e xDrive Touring Aut. Kombi, 5-türig, Automatik, '
          '8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 530e xDrive Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987810%27 HTTP/1.1" 200 None
2026-03-29 02:45:39 [ayvens.de] INFO: Saving data for 1987810: {'auction_closing_time': 1774875600.0, 'created_time': 1774648067.779447, 'last_price_update_time': 1774752339.749417}
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987810') HTTP/1.1" 204 0
2026-03-29 02:45:39 [ayvens.de] INFO: Found listing with ID: 1987811
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987811%27 HTTP/1.1" 200 None
2026-03-29 02:45:39 [ayvens.de] INFO: Scrape type for 1987811: 2
2026-03-29 02:45:39 [ayvens.de] INFO: Extracting data for car ID: 1987811
2026-03-29 02:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811
2026-03-29 02:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b with scrape type 2
2026-03-29 02:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b with scrape type 2
2026-03-29 02:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 91f1839d-895d-59eb-9f7e-44cd047bbe6b, identifier: 1987811
2026-03-29 02:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811
2026-03-29 02:45:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811
2026-03-29 02:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811 to the API
2026-03-29 02:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '91f1839d-895d-59eb-9f7e-44cd047bbe6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 154828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'ACTIVE X Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. ACTIVE X '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987811%27 HTTP/1.1" 200 None
2026-03-29 02:45:40 [ayvens.de] INFO: Saving data for 1987811: {'auction_closing_time': 1774875600.0, 'created_time': 1774648064.232541, 'last_price_update_time': 1774752340.165989}
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987811') HTTP/1.1" 204 0
2026-03-29 02:45:40 [ayvens.de] INFO: Found listing with ID: 1987812
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987812%27 HTTP/1.1" 200 None
2026-03-29 02:45:40 [ayvens.de] INFO: Scrape type for 1987812: 2
2026-03-29 02:45:40 [ayvens.de] INFO: Extracting data for car ID: 1987812
2026-03-29 02:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812
2026-03-29 02:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb85985-664b-5c97-b83b-fc4b23a647cc with scrape type 2
2026-03-29 02:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb85985-664b-5c97-b83b-fc4b23a647cc with scrape type 2
2026-03-29 02:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ffb85985-664b-5c97-b83b-fc4b23a647cc, identifier: 1987812
2026-03-29 02:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812
2026-03-29 02:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812
2026-03-29 02:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812 to the API
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ffb85985-664b-5c97-b83b-fc4b23a647cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 58788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 CRDi (48V Mild-Hybrid) DCT7 GT Line Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 CRDi (48V Mild-Hybrid) DCT7 GT Line Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2024}
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987812%27 HTTP/1.1" 200 None
2026-03-29 02:45:40 [ayvens.de] INFO: Saving data for 1987812: {'auction_closing_time': 1774875600.0, 'created_time': 1774648065.038782, 'last_price_update_time': 1774752340.663416}
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987812') HTTP/1.1" 204 0
2026-03-29 02:45:40 [ayvens.de] INFO: Found listing with ID: 1987813
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987813%27 HTTP/1.1" 200 None
2026-03-29 02:45:40 [ayvens.de] INFO: Scrape type for 1987813: 2
2026-03-29 02:45:40 [ayvens.de] INFO: Extracting data for car ID: 1987813
2026-03-29 02:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813
2026-03-29 02:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bca994f-e62e-5765-889a-7315dcc49884 with scrape type 2
2026-03-29 02:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bca994f-e62e-5765-889a-7315dcc49884 with scrape type 2
2026-03-29 02:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 4bca994f-e62e-5765-889a-7315dcc49884, identifier: 1987813
2026-03-29 02:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813
2026-03-29 02:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813
2026-03-29 02:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813 to the API
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '4bca994f-e62e-5765-889a-7315dcc49884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Sorento',
 'odometer': 123926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sorento KIA Sorento 2.2 CRDi DCT8 AWD Spirit Geschlossen, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Sorento 2.2 CRDi DCT8 AWD Spirit Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987813%27 HTTP/1.1" 200 None
2026-03-29 02:45:41 [ayvens.de] INFO: Saving data for 1987813: {'auction_closing_time': 1774875600.0, 'created_time': 1774648064.599538, 'last_price_update_time': 1774752341.055465}
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987813') HTTP/1.1" 204 0
2026-03-29 02:45:41 [ayvens.de] INFO: Found listing with ID: 1987814
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987814%27 HTTP/1.1" 200 None
2026-03-29 02:45:41 [ayvens.de] INFO: Scrape type for 1987814: 2
2026-03-29 02:45:41 [ayvens.de] INFO: Extracting data for car ID: 1987814
2026-03-29 02:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814
2026-03-29 02:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c180953-cafe-5795-8743-28379de956c3 with scrape type 2
2026-03-29 02:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c180953-cafe-5795-8743-28379de956c3 with scrape type 2
2026-03-29 02:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1c180953-cafe-5795-8743-28379de956c3, identifier: 1987814
2026-03-29 02:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814
2026-03-29 02:45:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814
2026-03-29 02:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814 to the API
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 50,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1c180953-cafe-5795-8743-28379de956c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 113885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 e 4Matic 9G-TRONIC '
          'Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 e 4Matic 9G-TRONIC Geschlossen, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987814%27 HTTP/1.1" 200 None
2026-03-29 02:45:41 [ayvens.de] INFO: Saving data for 1987814: {'auction_closing_time': 1774875600.0, 'created_time': 1774648062.741748, 'last_price_update_time': 1774752341.476203}
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987814') HTTP/1.1" 204 0
2026-03-29 02:45:41 [ayvens.de] INFO: Found listing with ID: 1987815
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987815%27 HTTP/1.1" 200 None
2026-03-29 02:45:41 [ayvens.de] INFO: Scrape type for 1987815: 2
2026-03-29 02:45:41 [ayvens.de] INFO: Extracting data for car ID: 1987815
2026-03-29 02:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815
2026-03-29 02:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with scrape type 2
2026-03-29 02:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with scrape type 2
2026-03-29 02:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2baf6cbe-5433-5085-b718-4d69d8b7fc17, identifier: 1987815
2026-03-29 02:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815
2026-03-29 02:45:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815
2026-03-29 02:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815 to the API
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2baf6cbe-5433-5085-b718-4d69d8b7fc17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2014',
 'odometer': 167445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seats_number': 8,
 'seller_name': None,
 'title': 'RENAULT Trafic 2014 RENAULT Trafic ENERGY dCi 125 Combi Expression '
          'Kombi, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 125 Combi Expression Kombi, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2018}
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987815%27 HTTP/1.1" 200 None
2026-03-29 02:45:41 [ayvens.de] INFO: Saving data for 1987815: {'auction_closing_time': 1774875600.0, 'created_time': 1774647971.169328, 'last_price_update_time': 1774752341.868871}
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987815') HTTP/1.1" 204 0
2026-03-29 02:45:41 [ayvens.de] INFO: Found listing with ID: 1987816
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987816%27 HTTP/1.1" 200 None
2026-03-29 02:45:41 [ayvens.de] INFO: Scrape type for 1987816: 2
2026-03-29 02:45:41 [ayvens.de] INFO: Extracting data for car ID: 1987816
2026-03-29 02:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816
2026-03-29 02:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c with scrape type 2
2026-03-29 02:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c with scrape type 2
2026-03-29 02:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3512e5e9-2072-5b9d-80e8-9b29b80f260c, identifier: 1987816
2026-03-29 02:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816
2026-03-29 02:45:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816
2026-03-29 02:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816 to the API
2026-03-29 02:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '3512e5e9-2072-5b9d-80e8-9b29b80f260c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 96142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987816%27 HTTP/1.1" 200 None
2026-03-29 02:45:43 [ayvens.de] INFO: Saving data for 1987816: {'auction_closing_time': 1774875600.0, 'created_time': 1774647971.66068, 'last_price_update_time': 1774752343.084322}
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987816') HTTP/1.1" 204 0
2026-03-29 02:45:43 [ayvens.de] INFO: Found listing with ID: 1987817
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987817%27 HTTP/1.1" 200 None
2026-03-29 02:45:43 [ayvens.de] INFO: Scrape type for 1987817: 2
2026-03-29 02:45:43 [ayvens.de] INFO: Extracting data for car ID: 1987817
2026-03-29 02:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817
2026-03-29 02:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae with scrape type 2
2026-03-29 02:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae with scrape type 2
2026-03-29 02:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e8dd9675-9ee2-584f-ab33-8a05b032d0ae, identifier: 1987817
2026-03-29 02:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817
2026-03-29 02:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817
2026-03-29 02:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817 to the API
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e8dd9675-9ee2-584f-ab33-8a05b032d0ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90',
 'odometer': 200626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 VOLVO V90 T6 Recharge AWD Geartronic Inscription '
          'Expression Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'VOLVO V90 T6 Recharge AWD Geartronic Inscription Expression Kombi, '
         '5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987817%27 HTTP/1.1" 200 None
2026-03-29 02:45:43 [ayvens.de] INFO: Saving data for 1987817: {'auction_closing_time': 1774875600.0, 'created_time': 1774648062.014253, 'last_price_update_time': 1774752343.464295}
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987817') HTTP/1.1" 204 0
2026-03-29 02:45:43 [ayvens.de] INFO: Found listing with ID: 1987818
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987818%27 HTTP/1.1" 200 None
2026-03-29 02:45:43 [ayvens.de] INFO: Scrape type for 1987818: 2
2026-03-29 02:45:43 [ayvens.de] INFO: Extracting data for car ID: 1987818
2026-03-29 02:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818
2026-03-29 02:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with scrape type 2
2026-03-29 02:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with scrape type 2
2026-03-29 02:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6, identifier: 1987818
2026-03-29 02:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818
2026-03-29 02:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818
2026-03-29 02:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818 to the API
2026-03-29 02:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '70aed79a-c0c2-54b7-81ee-0ace2d3544b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Ranger',
 'odometer': 108646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Ranger FORD Ranger 2,0 l EcoBlue Autm. XLT Doppelk.Pritsche, '
          '4-türig, Automatik, 10-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Ranger 2,0 l EcoBlue Autm. XLT Doppelk.Pritsche, 4-türig, '
         'Automatik, 10-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987818%27 HTTP/1.1" 200 None
2026-03-29 02:45:44 [ayvens.de] INFO: Saving data for 1987818: {'auction_closing_time': 1774875600.0, 'created_time': 1774648062.36131, 'last_price_update_time': 1774752344.574951}
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987818') HTTP/1.1" 204 0
2026-03-29 02:45:44 [ayvens.de] INFO: Found listing with ID: 1987819
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987819%27 HTTP/1.1" 200 None
2026-03-29 02:45:44 [ayvens.de] INFO: Scrape type for 1987819: 2
2026-03-29 02:45:44 [ayvens.de] INFO: Extracting data for car ID: 1987819
2026-03-29 02:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819
2026-03-29 02:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with scrape type 2
2026-03-29 02:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with scrape type 2
2026-03-29 02:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0fc3dcb3-8afc-5e32-8e28-c314f8364304, identifier: 1987819
2026-03-29 02:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819
2026-03-29 02:45:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819
2026-03-29 02:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819 to the API
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '0fc3dcb3-8afc-5e32-8e28-c314f8364304',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 95491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI Kona EV Premium Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Kona EV Premium Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2019}
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987819%27 HTTP/1.1" 200 None
2026-03-29 02:45:45 [ayvens.de] INFO: Saving data for 1987819: {'auction_closing_time': 1774875600.0, 'created_time': 1774647974.145616, 'last_price_update_time': 1774752345.00906}
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987819') HTTP/1.1" 204 0
2026-03-29 02:45:45 [ayvens.de] INFO: Found listing with ID: 1987820
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987820%27 HTTP/1.1" 200 None
2026-03-29 02:45:45 [ayvens.de] INFO: Scrape type for 1987820: 2
2026-03-29 02:45:45 [ayvens.de] INFO: Extracting data for car ID: 1987820
2026-03-29 02:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820
2026-03-29 02:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with scrape type 2
2026-03-29 02:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with scrape type 2
2026-03-29 02:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510, identifier: 1987820
2026-03-29 02:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820
2026-03-29 02:45:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820
2026-03-29 02:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820 to the API
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 59750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987820%27 HTTP/1.1" 200 None
2026-03-29 02:45:45 [ayvens.de] INFO: Saving data for 1987820: {'auction_closing_time': 1774875600.0, 'created_time': 1774648060.428208, 'last_price_update_time': 1774752345.479609}
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987820') HTTP/1.1" 204 0
2026-03-29 02:45:45 [ayvens.de] INFO: Found listing with ID: 1987821
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987821%27 HTTP/1.1" 200 None
2026-03-29 02:45:45 [ayvens.de] INFO: Scrape type for 1987821: 2
2026-03-29 02:45:45 [ayvens.de] INFO: Extracting data for car ID: 1987821
2026-03-29 02:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821
2026-03-29 02:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f45f3d-7673-513b-a5fc-a126aac5ba70 with scrape type 2
2026-03-29 02:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02f45f3d-7673-513b-a5fc-a126aac5ba70 with scrape type 2
2026-03-29 02:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 02f45f3d-7673-513b-a5fc-a126aac5ba70, identifier: 1987821
2026-03-29 02:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821
2026-03-29 02:45:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821
2026-03-29 02:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821 to the API
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '02f45f3d-7673-513b-a5fc-a126aac5ba70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 82004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV COOL&CONNECT Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV COOL&CONNECT Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987821%27 HTTP/1.1" 200 None
2026-03-29 02:45:45 [ayvens.de] INFO: Saving data for 1987821: {'auction_closing_time': 1774875600.0, 'created_time': 1774648059.209663, 'last_price_update_time': 1774752345.882075}
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987821') HTTP/1.1" 204 0
2026-03-29 02:45:45 [ayvens.de] INFO: Found listing with ID: 1987822
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987822%27 HTTP/1.1" 200 None
2026-03-29 02:45:45 [ayvens.de] INFO: Scrape type for 1987822: 2
2026-03-29 02:45:45 [ayvens.de] INFO: Extracting data for car ID: 1987822
2026-03-29 02:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822
2026-03-29 02:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4afe9d-4063-566b-83a4-cf5e28664e34 with scrape type 2
2026-03-29 02:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4afe9d-4063-566b-83a4-cf5e28664e34 with scrape type 2
2026-03-29 02:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3b4afe9d-4063-566b-83a4-cf5e28664e34, identifier: 1987822
2026-03-29 02:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822
2026-03-29 02:45:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822
2026-03-29 02:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822 to the API
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schneewei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '3b4afe9d-4063-566b-83a4-cf5e28664e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 93960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987822%27 HTTP/1.1" 200 None
2026-03-29 02:45:46 [ayvens.de] INFO: Saving data for 1987822: {'auction_closing_time': 1774875600.0, 'created_time': 1774648058.226217, 'last_price_update_time': 1774752346.314133}
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987822') HTTP/1.1" 204 0
2026-03-29 02:45:46 [ayvens.de] INFO: Found listing with ID: 1987823
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987823%27 HTTP/1.1" 200 None
2026-03-29 02:45:46 [ayvens.de] INFO: Scrape type for 1987823: 2
2026-03-29 02:45:46 [ayvens.de] INFO: Extracting data for car ID: 1987823
2026-03-29 02:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823
2026-03-29 02:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b257a8d2-10f6-5902-8ae1-e44169a83343 with scrape type 2
2026-03-29 02:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b257a8d2-10f6-5902-8ae1-e44169a83343 with scrape type 2
2026-03-29 02:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b257a8d2-10f6-5902-8ae1-e44169a83343, identifier: 1987823
2026-03-29 02:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823
2026-03-29 02:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823
2026-03-29 02:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823 to the API
2026-03-29 02:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b257a8d2-10f6-5902-8ae1-e44169a83343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Sorento',
 'odometer': 135909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sorento KIA Sorento 1.6 T-GDI PHEV AWD Aut. Platinum '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Sorento 1.6 T-GDI PHEV AWD Aut. Platinum Geschlossen, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987823%27 HTTP/1.1" 200 None
2026-03-29 02:45:47 [ayvens.de] INFO: Saving data for 1987823: {'auction_closing_time': 1774875600.0, 'created_time': 1774648060.063411, 'last_price_update_time': 1774752347.58371}
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987823') HTTP/1.1" 204 0
2026-03-29 02:45:47 [ayvens.de] INFO: Found listing with ID: 1987824
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987824%27 HTTP/1.1" 200 None
2026-03-29 02:45:47 [ayvens.de] INFO: Scrape type for 1987824: 2
2026-03-29 02:45:47 [ayvens.de] INFO: Extracting data for car ID: 1987824
2026-03-29 02:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824
2026-03-29 02:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with scrape type 2
2026-03-29 02:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with scrape type 2
2026-03-29 02:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4, identifier: 1987824
2026-03-29 02:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824
2026-03-29 02:45:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824
2026-03-29 02:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824 to the API
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Nachtschwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 124835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse MERCEDES-BENZ A 250 e 8G-DCT AMG Line '
          'Limousine, 4-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ A 250 e 8G-DCT AMG Line Limousine, 4-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987824%27 HTTP/1.1" 200 None
2026-03-29 02:45:48 [ayvens.de] INFO: Saving data for 1987824: {'auction_closing_time': 1774875600.0, 'created_time': 1774648057.377054, 'last_price_update_time': 1774752348.01149}
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987824') HTTP/1.1" 204 0
2026-03-29 02:45:48 [ayvens.de] INFO: Found listing with ID: 1987825
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987825%27 HTTP/1.1" 200 None
2026-03-29 02:45:48 [ayvens.de] INFO: Scrape type for 1987825: 2
2026-03-29 02:45:48 [ayvens.de] INFO: Extracting data for car ID: 1987825
2026-03-29 02:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825
2026-03-29 02:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac9f502-c22b-54bf-8b72-197c7d71877c with scrape type 2
2026-03-29 02:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac9f502-c22b-54bf-8b72-197c7d71877c with scrape type 2
2026-03-29 02:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cac9f502-c22b-54bf-8b72-197c7d71877c, identifier: 1987825
2026-03-29 02:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825
2026-03-29 02:45:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825
2026-03-29 02:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825 to the API
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'cac9f502-c22b-54bf-8b72-197c7d71877c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-Klasse',
 'odometer': 161966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-Klasse MERCEDES-BENZ E 300 de 4Matic T 9G-TRONIC '
          'AMG Line Kombi, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ E 300 de 4Matic T 9G-TRONIC AMG Line Kombi, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987825%27 HTTP/1.1" 200 None
2026-03-29 02:45:48 [ayvens.de] INFO: Saving data for 1987825: {'auction_closing_time': 1774875600.0, 'created_time': 1774648056.818734, 'last_price_update_time': 1774752348.412637}
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987825') HTTP/1.1" 204 0
2026-03-29 02:45:48 [ayvens.de] INFO: Found listing with ID: 1987826
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987826%27 HTTP/1.1" 200 None
2026-03-29 02:45:48 [ayvens.de] INFO: Scrape type for 1987826: 2
2026-03-29 02:45:48 [ayvens.de] INFO: Extracting data for car ID: 1987826
2026-03-29 02:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826
2026-03-29 02:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b202eabb-6a9d-5675-ba39-c39223454832 with scrape type 2
2026-03-29 02:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b202eabb-6a9d-5675-ba39-c39223454832 with scrape type 2
2026-03-29 02:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b202eabb-6a9d-5675-ba39-c39223454832, identifier: 1987826
2026-03-29 02:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826
2026-03-29 02:45:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826
2026-03-29 02:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826 to the API
2026-03-29 02:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Ebony SE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b202eabb-6a9d-5675-ba39-c39223454832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover Velar',
 'odometer': 144819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover Velar LAND ROVER Range Rover Velar 3.0d '
          'R-Dynamic SE Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover Velar 3.0d R-Dynamic SE Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2019}
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987826%27 HTTP/1.1" 200 None
2026-03-29 02:45:49 [ayvens.de] INFO: Saving data for 1987826: {'auction_closing_time': 1774875600.0, 'created_time': 1774648056.466926, 'last_price_update_time': 1774752349.57962}
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987826') HTTP/1.1" 204 0
2026-03-29 02:45:49 [ayvens.de] INFO: Found listing with ID: 1987827
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987827%27 HTTP/1.1" 200 None
2026-03-29 02:45:49 [ayvens.de] INFO: Scrape type for 1987827: 2
2026-03-29 02:45:49 [ayvens.de] INFO: Extracting data for car ID: 1987827
2026-03-29 02:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827
2026-03-29 02:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88515227-8cf6-5459-a037-07153bf076c5 with scrape type 2
2026-03-29 02:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88515227-8cf6-5459-a037-07153bf076c5 with scrape type 2
2026-03-29 02:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 88515227-8cf6-5459-a037-07153bf076c5, identifier: 1987827
2026-03-29 02:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827
2026-03-29 02:45:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827
2026-03-29 02:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827 to the API
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '88515227-8cf6-5459-a037-07153bf076c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'Leaf',
 'odometer': 31026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN Leaf NISSAN Leaf 40 kWh Tekna Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'NISSAN Leaf 40 kWh Tekna Limousine, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987827%27 HTTP/1.1" 200 None
2026-03-29 02:45:49 [ayvens.de] INFO: Saving data for 1987827: {'auction_closing_time': 1774875600.0, 'created_time': 1774647984.395073, 'last_price_update_time': 1774752349.989881}
2026-03-29 02:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987827') HTTP/1.1" 204 0
2026-03-29 02:45:50 [ayvens.de] INFO: Found listing with ID: 1987828
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987828%27 HTTP/1.1" 200 None
2026-03-29 02:45:50 [ayvens.de] INFO: Scrape type for 1987828: 2
2026-03-29 02:45:50 [ayvens.de] INFO: Extracting data for car ID: 1987828
2026-03-29 02:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828
2026-03-29 02:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f1de79-de4e-5ea6-acdb-403764399b2f with scrape type 2
2026-03-29 02:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f1de79-de4e-5ea6-acdb-403764399b2f with scrape type 2
2026-03-29 02:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 89f1de79-de4e-5ea6-acdb-403764399b2f, identifier: 1987828
2026-03-29 02:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828
2026-03-29 02:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828
2026-03-29 02:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828 to the API
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 5,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '89f1de79-de4e-5ea6-acdb-403764399b2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 141837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo ENERGY dCi 90 FAP Start & Stop '
          'LIMITED Kombi, 5-türig, 5-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo ENERGY dCi 90 FAP Start & Stop LIMITED Kombi, '
         '5-türig, 5-Gang',
 'vin': None,
 'year': 2018}
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987828%27 HTTP/1.1" 200 None
2026-03-29 02:45:50 [ayvens.de] INFO: Saving data for 1987828: {'auction_closing_time': 1774875600.0, 'created_time': 1774648055.535248, 'last_price_update_time': 1774752350.372673}
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987828') HTTP/1.1" 204 0
2026-03-29 02:45:50 [ayvens.de] INFO: Found listing with ID: 1987829
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987829%27 HTTP/1.1" 200 None
2026-03-29 02:45:50 [ayvens.de] INFO: Scrape type for 1987829: 2
2026-03-29 02:45:50 [ayvens.de] INFO: Extracting data for car ID: 1987829
2026-03-29 02:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829
2026-03-29 02:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a9c1bd-8d23-5913-a3dd-c01064b41960 with scrape type 2
2026-03-29 02:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a9c1bd-8d23-5913-a3dd-c01064b41960 with scrape type 2
2026-03-29 02:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 28a9c1bd-8d23-5913-a3dd-c01064b41960, identifier: 1987829
2026-03-29 02:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829
2026-03-29 02:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829
2026-03-29 02:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829 to the API
2026-03-29 02:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '28a9c1bd-8d23-5913-a3dd-c01064b41960',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 83381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo Rapid Blue dCi 95 Extra Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo Rapid Blue dCi 95 Extra Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987829%27 HTTP/1.1" 200 None
2026-03-29 02:45:51 [ayvens.de] INFO: Saving data for 1987829: {'auction_closing_time': 1774875600.0, 'created_time': 1774648053.837974, 'last_price_update_time': 1774752351.575812}
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987829') HTTP/1.1" 204 0
2026-03-29 02:45:51 [ayvens.de] INFO: Found listing with ID: 1987830
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987830%27 HTTP/1.1" 200 None
2026-03-29 02:45:51 [ayvens.de] INFO: Scrape type for 1987830: 2
2026-03-29 02:45:51 [ayvens.de] INFO: Extracting data for car ID: 1987830
2026-03-29 02:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830
2026-03-29 02:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f8d120-7eb7-57e2-9516-50aa45264540 with scrape type 2
2026-03-29 02:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21f8d120-7eb7-57e2-9516-50aa45264540 with scrape type 2
2026-03-29 02:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 21f8d120-7eb7-57e2-9516-50aa45264540, identifier: 1987830
2026-03-29 02:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830
2026-03-29 02:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830
2026-03-29 02:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830 to the API
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '21f8d120-7eb7-57e2-9516-50aa45264540',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master III',
 'odometer': 98365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master III RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2017}
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987830%27 HTTP/1.1" 200 None
2026-03-29 02:45:51 [ayvens.de] INFO: Saving data for 1987830: {'auction_closing_time': 1774875600.0, 'created_time': 1774648054.236258, 'last_price_update_time': 1774752351.988059}
2026-03-29 02:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987830') HTTP/1.1" 204 0
2026-03-29 02:45:52 [ayvens.de] INFO: Found listing with ID: 1987831
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987831%27 HTTP/1.1" 200 None
2026-03-29 02:45:52 [ayvens.de] INFO: Scrape type for 1987831: 2
2026-03-29 02:45:52 [ayvens.de] INFO: Extracting data for car ID: 1987831
2026-03-29 02:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831
2026-03-29 02:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 052add88-9d1c-5310-9347-fd5cf7a1ae63 with scrape type 2
2026-03-29 02:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 052add88-9d1c-5310-9347-fd5cf7a1ae63 with scrape type 2
2026-03-29 02:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 052add88-9d1c-5310-9347-fd5cf7a1ae63, identifier: 1987831
2026-03-29 02:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831
2026-03-29 02:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831
2026-03-29 02:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831 to the API
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '052add88-9d1c-5310-9347-fd5cf7a1ae63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo Rapid III',
 'odometer': 145844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT Kangoo Rapid III RENAULT Kangoo Rapid Blue dCi 95 Advance '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo Rapid Blue dCi 95 Advance Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987831%27 HTTP/1.1" 200 None
2026-03-29 02:45:52 [ayvens.de] INFO: Saving data for 1987831: {'auction_closing_time': 1774875600.0, 'created_time': 1774648054.631017, 'last_price_update_time': 1774752352.385249}
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987831') HTTP/1.1" 204 0
2026-03-29 02:45:52 [ayvens.de] INFO: Found listing with ID: 1987832
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987832%27 HTTP/1.1" 200 None
2026-03-29 02:45:52 [ayvens.de] INFO: Scrape type for 1987832: 2
2026-03-29 02:45:52 [ayvens.de] INFO: Extracting data for car ID: 1987832
2026-03-29 02:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832
2026-03-29 02:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe116abe-1e90-5c09-848c-01aa25b4906b with scrape type 2
2026-03-29 02:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe116abe-1e90-5c09-848c-01aa25b4906b with scrape type 2
2026-03-29 02:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fe116abe-1e90-5c09-848c-01aa25b4906b, identifier: 1987832
2026-03-29 02:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832
2026-03-29 02:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832
2026-03-29 02:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832 to the API
2026-03-29 02:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe116abe-1e90-5c09-848c-01aa25b4906b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 294522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 120 L1H1 2,8t Komfort '
          'Kasten, 3-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 120 L1H1 2,8t Komfort Kasten, 3-türig, '
         '6-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987832%27 HTTP/1.1" 200 None
2026-03-29 02:45:53 [ayvens.de] INFO: Saving data for 1987832: {'auction_closing_time': 1774875600.0, 'created_time': 1774647991.469114, 'last_price_update_time': 1774752353.583302}
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987832') HTTP/1.1" 204 0
2026-03-29 02:45:53 [ayvens.de] INFO: Found listing with ID: 1987833
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987833%27 HTTP/1.1" 200 None
2026-03-29 02:45:53 [ayvens.de] INFO: Scrape type for 1987833: 2
2026-03-29 02:45:53 [ayvens.de] INFO: Extracting data for car ID: 1987833
2026-03-29 02:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833
2026-03-29 02:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with scrape type 2
2026-03-29 02:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with scrape type 2
2026-03-29 02:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7, identifier: 1987833
2026-03-29 02:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833
2026-03-29 02:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833
2026-03-29 02:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833 to the API
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '747f8f0a-eed0-53ca-ab31-b445afeb6ca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 49905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t '
          'Komfort Kasten, 3-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t Komfort Kasten, 3-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987833%27 HTTP/1.1" 200 None
2026-03-29 02:45:53 [ayvens.de] INFO: Saving data for 1987833: {'auction_closing_time': 1774875600.0, 'created_time': 1774647993.089953, 'last_price_update_time': 1774752353.978801}
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987833') HTTP/1.1" 204 0
2026-03-29 02:45:54 [ayvens.de] INFO: Found listing with ID: 1987834
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987834%27 HTTP/1.1" 200 None
2026-03-29 02:45:54 [ayvens.de] INFO: Scrape type for 1987834: 2
2026-03-29 02:45:54 [ayvens.de] INFO: Extracting data for car ID: 1987834
2026-03-29 02:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834
2026-03-29 02:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836e1e80-3295-5752-844c-de3042ce5cae with scrape type 2
2026-03-29 02:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 836e1e80-3295-5752-844c-de3042ce5cae with scrape type 2
2026-03-29 02:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 836e1e80-3295-5752-844c-de3042ce5cae, identifier: 1987834
2026-03-29 02:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834
2026-03-29 02:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834
2026-03-29 02:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834 to the API
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '836e1e80-3295-5752-844c-de3042ce5cae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 72005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t '
          'Komfort Kasten, 3-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t Komfort Kasten, 3-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987834%27 HTTP/1.1" 200 None
2026-03-29 02:45:54 [ayvens.de] INFO: Saving data for 1987834: {'auction_closing_time': 1774875600.0, 'created_time': 1774648051.461981, 'last_price_update_time': 1774752354.459734}
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987834') HTTP/1.1" 204 0
2026-03-29 02:45:54 [ayvens.de] INFO: Found listing with ID: 1987835
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987835%27 HTTP/1.1" 200 None
2026-03-29 02:45:54 [ayvens.de] INFO: Scrape type for 1987835: 2
2026-03-29 02:45:54 [ayvens.de] INFO: Extracting data for car ID: 1987835
2026-03-29 02:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835
2026-03-29 02:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5edebf2f-39b1-5262-af93-1b183d6505b3 with scrape type 2
2026-03-29 02:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5edebf2f-39b1-5262-af93-1b183d6505b3 with scrape type 2
2026-03-29 02:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 5edebf2f-39b1-5262-af93-1b183d6505b3, identifier: 1987835
2026-03-29 02:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835
2026-03-29 02:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835
2026-03-29 02:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835 to the API
2026-03-29 02:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5edebf2f-39b1-5262-af93-1b183d6505b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 55165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t '
          'Komfort Kasten, 3-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t Komfort Kasten, 3-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987835%27 HTTP/1.1" 200 None
2026-03-29 02:45:55 [ayvens.de] INFO: Saving data for 1987835: {'auction_closing_time': 1774875600.0, 'created_time': 1774648052.322445, 'last_price_update_time': 1774752355.580034}
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987835') HTTP/1.1" 204 0
2026-03-29 02:45:55 [ayvens.de] INFO: Found listing with ID: 1987836
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987836%27 HTTP/1.1" 200 None
2026-03-29 02:45:55 [ayvens.de] INFO: Scrape type for 1987836: 2
2026-03-29 02:45:55 [ayvens.de] INFO: Extracting data for car ID: 1987836
2026-03-29 02:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836
2026-03-29 02:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d650dde2-2ff7-5de0-b981-a3c447df8783 with scrape type 2
2026-03-29 02:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d650dde2-2ff7-5de0-b981-a3c447df8783 with scrape type 2
2026-03-29 02:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d650dde2-2ff7-5de0-b981-a3c447df8783, identifier: 1987836
2026-03-29 02:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836
2026-03-29 02:45:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836
2026-03-29 02:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836 to the API
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd650dde2-2ff7-5de0-b981-a3c447df8783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 177478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia SKODA Octavia Combi 2.0 TDI DSG RS Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'SKODA Octavia Combi 2.0 TDI DSG RS Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987836%27 HTTP/1.1" 200 None
2026-03-29 02:45:55 [ayvens.de] INFO: Saving data for 1987836: {'auction_closing_time': 1774875600.0, 'created_time': 1774647996.880129, 'last_price_update_time': 1774752355.98341}
2026-03-29 02:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987836') HTTP/1.1" 204 0
2026-03-29 02:45:56 [ayvens.de] INFO: Found listing with ID: 1987837
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987837%27 HTTP/1.1" 200 None
2026-03-29 02:45:56 [ayvens.de] INFO: Scrape type for 1987837: 2
2026-03-29 02:45:56 [ayvens.de] INFO: Extracting data for car ID: 1987837
2026-03-29 02:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837
2026-03-29 02:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae1d44a-684e-510d-bea8-c7c74b26e8a6 with scrape type 2
2026-03-29 02:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae1d44a-684e-510d-bea8-c7c74b26e8a6 with scrape type 2
2026-03-29 02:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cae1d44a-684e-510d-bea8-c7c74b26e8a6, identifier: 1987837
2026-03-29 02:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837
2026-03-29 02:45:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837
2026-03-29 02:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837 to the API
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'cae1d44a-684e-510d-bea8-c7c74b26e8a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model 3',
 'odometer': 97269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model 3 TESLA Model 3 RWD Hinterradantrieb Limousine, '
          '4-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model 3 RWD Hinterradantrieb Limousine, 4-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987837%27 HTTP/1.1" 200 None
2026-03-29 02:45:56 [ayvens.de] INFO: Saving data for 1987837: {'auction_closing_time': 1774875600.0, 'created_time': 1774648050.8876, 'last_price_update_time': 1774752356.413596}
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987837') HTTP/1.1" 204 0
2026-03-29 02:45:56 [ayvens.de] INFO: Found listing with ID: 1987838
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987838%27 HTTP/1.1" 200 None
2026-03-29 02:45:56 [ayvens.de] INFO: Scrape type for 1987838: 2
2026-03-29 02:45:56 [ayvens.de] INFO: Extracting data for car ID: 1987838
2026-03-29 02:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838
2026-03-29 02:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 138fcc83-86b2-5713-a312-3a45ecb88a91 with scrape type 2
2026-03-29 02:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 138fcc83-86b2-5713-a312-3a45ecb88a91 with scrape type 2
2026-03-29 02:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 138fcc83-86b2-5713-a312-3a45ecb88a91, identifier: 1987838
2026-03-29 02:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838
2026-03-29 02:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838
2026-03-29 02:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838 to the API
2026-03-29 02:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '138fcc83-86b2-5713-a312-3a45ecb88a91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 62809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987838%27 HTTP/1.1" 200 None
2026-03-29 02:45:57 [ayvens.de] INFO: Saving data for 1987838: {'auction_closing_time': 1774875600.0, 'created_time': 1774648049.579992, 'last_price_update_time': 1774752357.585364}
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987838') HTTP/1.1" 204 0
2026-03-29 02:45:57 [ayvens.de] INFO: Found listing with ID: 1987839
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987839%27 HTTP/1.1" 200 None
2026-03-29 02:45:57 [ayvens.de] INFO: Scrape type for 1987839: 2
2026-03-29 02:45:57 [ayvens.de] INFO: Extracting data for car ID: 1987839
2026-03-29 02:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839
2026-03-29 02:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe14d394-f771-5ddc-bdab-8d9784a50990 with scrape type 2
2026-03-29 02:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe14d394-f771-5ddc-bdab-8d9784a50990 with scrape type 2
2026-03-29 02:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fe14d394-f771-5ddc-bdab-8d9784a50990, identifier: 1987839
2026-03-29 02:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839
2026-03-29 02:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839
2026-03-29 02:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839 to the API
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe14d394-f771-5ddc-bdab-8d9784a50990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Caddy 4',
 'odometer': 250126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN Caddy 4 VW Caddy 2.0 TDI (7-Si.) DSG Maxi Comfortline '
          'Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Caddy 2.0 TDI (7-Si.) DSG Maxi Comfortline Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-29 02:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987839%27 HTTP/1.1" 200 None
2026-03-29 02:45:58 [ayvens.de] INFO: Saving data for 1987839: {'auction_closing_time': 1774875600.0, 'created_time': 1774648001.086358, 'last_price_update_time': 1774752358.00227}
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987839') HTTP/1.1" 204 0
2026-03-29 02:45:58 [ayvens.de] INFO: Found listing with ID: 1987840
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987840%27 HTTP/1.1" 200 None
2026-03-29 02:45:58 [ayvens.de] INFO: Scrape type for 1987840: 2
2026-03-29 02:45:58 [ayvens.de] INFO: Extracting data for car ID: 1987840
2026-03-29 02:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840
2026-03-29 02:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7689342-a36f-581d-b680-0171ea507b1e with scrape type 2
2026-03-29 02:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7689342-a36f-581d-b680-0171ea507b1e with scrape type 2
2026-03-29 02:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a7689342-a36f-581d-b680-0171ea507b1e, identifier: 1987840
2026-03-29 02:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840
2026-03-29 02:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840
2026-03-29 02:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840 to the API
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a7689342-a36f-581d-b680-0171ea507b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Touran',
 'odometer': 198751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Touran VW Touran 2.0 TDI SCR Comfortline Kombi, 5-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'VW Touran 2.0 TDI SCR Comfortline Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987840%27 HTTP/1.1" 200 None
2026-03-29 02:45:58 [ayvens.de] INFO: Saving data for 1987840: {'auction_closing_time': 1774875600.0, 'created_time': 1774648051.931133, 'last_price_update_time': 1774752358.411849}
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987840') HTTP/1.1" 204 0
2026-03-29 02:45:58 [ayvens.de] INFO: Found listing with ID: 1987841
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987841%27 HTTP/1.1" 200 None
2026-03-29 02:45:58 [ayvens.de] INFO: Scrape type for 1987841: 2
2026-03-29 02:45:58 [ayvens.de] INFO: Extracting data for car ID: 1987841
2026-03-29 02:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841
2026-03-29 02:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with scrape type 2
2026-03-29 02:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with scrape type 2
2026-03-29 02:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6, identifier: 1987841
2026-03-29 02:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841
2026-03-29 02:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841
2026-03-29 02:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841 to the API
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 130928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987841%27 HTTP/1.1" 200 None
2026-03-29 02:45:58 [ayvens.de] INFO: Saving data for 1987841: {'auction_closing_time': 1774875600.0, 'created_time': 1774648048.742207, 'last_price_update_time': 1774752358.796571}
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987841') HTTP/1.1" 204 0
2026-03-29 02:45:58 [ayvens.de] INFO: Found listing with ID: 1987842
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987842%27 HTTP/1.1" 200 None
2026-03-29 02:45:58 [ayvens.de] INFO: Scrape type for 1987842: 2
2026-03-29 02:45:58 [ayvens.de] INFO: Extracting data for car ID: 1987842
2026-03-29 02:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842
2026-03-29 02:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90e19ec-6ff9-535f-883b-246aecf6dbd4 with scrape type 2
2026-03-29 02:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f90e19ec-6ff9-535f-883b-246aecf6dbd4 with scrape type 2
2026-03-29 02:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f90e19ec-6ff9-535f-883b-246aecf6dbd4, identifier: 1987842
2026-03-29 02:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842
2026-03-29 02:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842
2026-03-29 02:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842 to the API
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'f90e19ec-6ff9-535f-883b-246aecf6dbd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5er',
 'odometer': 231677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er BMW 520i Touring Aut. Luxury Line Kombi, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 520i Touring Aut. Luxury Line Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987842%27 HTTP/1.1" 200 None
2026-03-29 02:45:59 [ayvens.de] INFO: Saving data for 1987842: {'auction_closing_time': 1774875600.0, 'created_time': 1774648048.366534, 'last_price_update_time': 1774752359.184564}
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987842') HTTP/1.1" 204 0
2026-03-29 02:45:59 [ayvens.de] INFO: Found listing with ID: 1987843
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987843%27 HTTP/1.1" 200 None
2026-03-29 02:45:59 [ayvens.de] INFO: Scrape type for 1987843: 2
2026-03-29 02:45:59 [ayvens.de] INFO: Extracting data for car ID: 1987843
2026-03-29 02:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843
2026-03-29 02:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with scrape type 2
2026-03-29 02:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with scrape type 2
2026-03-29 02:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f, identifier: 1987843
2026-03-29 02:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843
2026-03-29 02:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843
2026-03-29 02:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843 to the API
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '18d079ae-05aa-51bf-9bf3-e2ba21597e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 106956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987843%27 HTTP/1.1" 200 None
2026-03-29 02:45:59 [ayvens.de] INFO: Saving data for 1987843: {'auction_closing_time': 1774875600.0, 'created_time': 1774648046.594751, 'last_price_update_time': 1774752359.589918}
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987843') HTTP/1.1" 204 0
2026-03-29 02:45:59 [ayvens.de] INFO: Found listing with ID: 1987844
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987844%27 HTTP/1.1" 200 None
2026-03-29 02:45:59 [ayvens.de] INFO: Scrape type for 1987844: 2
2026-03-29 02:45:59 [ayvens.de] INFO: Extracting data for car ID: 1987844
2026-03-29 02:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844
2026-03-29 02:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with scrape type 2
2026-03-29 02:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with scrape type 2
2026-03-29 02:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a, identifier: 1987844
2026-03-29 02:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844
2026-03-29 02:45:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844
2026-03-29 02:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844 to the API
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9bc91e22-718f-5a4f-aeb2-681e82de5d6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 97188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987844%27 HTTP/1.1" 200 None
2026-03-29 02:46:00 [ayvens.de] INFO: Saving data for 1987844: {'auction_closing_time': 1774875600.0, 'created_time': 1774648047.981174, 'last_price_update_time': 1774752360.011634}
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987844') HTTP/1.1" 204 0
2026-03-29 02:46:00 [ayvens.de] INFO: Found listing with ID: 1987845
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987845%27 HTTP/1.1" 200 None
2026-03-29 02:46:00 [ayvens.de] INFO: Scrape type for 1987845: 2
2026-03-29 02:46:00 [ayvens.de] INFO: Extracting data for car ID: 1987845
2026-03-29 02:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845
2026-03-29 02:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82df55c2-fb17-5385-98de-cbc04369142e with scrape type 2
2026-03-29 02:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82df55c2-fb17-5385-98de-cbc04369142e with scrape type 2
2026-03-29 02:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 82df55c2-fb17-5385-98de-cbc04369142e, identifier: 1987845
2026-03-29 02:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845
2026-03-29 02:46:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845
2026-03-29 02:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845 to the API
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '82df55c2-fb17-5385-98de-cbc04369142e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 58656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987845%27 HTTP/1.1" 200 None
2026-03-29 02:46:00 [ayvens.de] INFO: Saving data for 1987845: {'auction_closing_time': 1774875600.0, 'created_time': 1774648045.901239, 'last_price_update_time': 1774752360.528325}
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987845') HTTP/1.1" 204 0
2026-03-29 02:46:00 [ayvens.de] INFO: Found listing with ID: 1987846
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987846%27 HTTP/1.1" 200 None
2026-03-29 02:46:00 [ayvens.de] INFO: Scrape type for 1987846: 2
2026-03-29 02:46:00 [ayvens.de] INFO: Extracting data for car ID: 1987846
2026-03-29 02:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846
2026-03-29 02:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150aac3d-1733-539d-9878-e95c3f9c26a1 with scrape type 2
2026-03-29 02:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 150aac3d-1733-539d-9878-e95c3f9c26a1 with scrape type 2
2026-03-29 02:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 150aac3d-1733-539d-9878-e95c3f9c26a1, identifier: 1987846
2026-03-29 02:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846
2026-03-29 02:46:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846
2026-03-29 02:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846 to the API
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '150aac3d-1733-539d-9878-e95c3f9c26a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 65228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987846%27 HTTP/1.1" 200 None
2026-03-29 02:46:00 [ayvens.de] INFO: Saving data for 1987846: {'auction_closing_time': 1774875600.0, 'created_time': 1774648045.154718, 'last_price_update_time': 1774752360.962701}
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987846') HTTP/1.1" 204 0
2026-03-29 02:46:00 [ayvens.de] INFO: Found listing with ID: 1987847
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987847%27 HTTP/1.1" 200 None
2026-03-29 02:46:00 [ayvens.de] INFO: Scrape type for 1987847: 2
2026-03-29 02:46:00 [ayvens.de] INFO: Extracting data for car ID: 1987847
2026-03-29 02:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847
2026-03-29 02:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e with scrape type 2
2026-03-29 02:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e with scrape type 2
2026-03-29 02:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 17039a9e-7bc6-55af-9f86-759a0a6cc33e, identifier: 1987847
2026-03-29 02:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847
2026-03-29 02:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847
2026-03-29 02:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847 to the API
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '17039a9e-7bc6-55af-9f86-759a0a6cc33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 39743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM Geschlossen, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987847%27 HTTP/1.1" 200 None
2026-03-29 02:46:01 [ayvens.de] INFO: Saving data for 1987847: {'auction_closing_time': 1774875600.0, 'created_time': 1774648044.120773, 'last_price_update_time': 1774752361.362118}
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987847') HTTP/1.1" 204 0
2026-03-29 02:46:01 [ayvens.de] INFO: Found listing with ID: 1987848
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987848%27 HTTP/1.1" 200 None
2026-03-29 02:46:01 [ayvens.de] INFO: Scrape type for 1987848: 2
2026-03-29 02:46:01 [ayvens.de] INFO: Extracting data for car ID: 1987848
2026-03-29 02:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848
2026-03-29 02:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfdcd71c-4580-5026-bdf8-35897f2160fd with scrape type 2
2026-03-29 02:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfdcd71c-4580-5026-bdf8-35897f2160fd with scrape type 2
2026-03-29 02:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: dfdcd71c-4580-5026-bdf8-35897f2160fd, identifier: 1987848
2026-03-29 02:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848
2026-03-29 02:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848
2026-03-29 02:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848 to the API
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'dfdcd71c-4580-5026-bdf8-35897f2160fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 66818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987848%27 HTTP/1.1" 200 None
2026-03-29 02:46:01 [ayvens.de] INFO: Saving data for 1987848: {'auction_closing_time': 1774875600.0, 'created_time': 1774648011.198984, 'last_price_update_time': 1774752361.743623}
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987848') HTTP/1.1" 204 0
2026-03-29 02:46:01 [ayvens.de] INFO: Found listing with ID: 1987849
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987849%27 HTTP/1.1" 200 None
2026-03-29 02:46:01 [ayvens.de] INFO: Scrape type for 1987849: 2
2026-03-29 02:46:01 [ayvens.de] INFO: Extracting data for car ID: 1987849
2026-03-29 02:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849
2026-03-29 02:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c446a52-197c-55b3-b20c-4efa3cd816ac with scrape type 2
2026-03-29 02:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c446a52-197c-55b3-b20c-4efa3cd816ac with scrape type 2
2026-03-29 02:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2c446a52-197c-55b3-b20c-4efa3cd816ac, identifier: 1987849
2026-03-29 02:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849
2026-03-29 02:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849
2026-03-29 02:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849 to the API
2026-03-29 02:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2c446a52-197c-55b3-b20c-4efa3cd816ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 21516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987849%27 HTTP/1.1" 200 None
2026-03-29 02:46:02 [ayvens.de] INFO: Saving data for 1987849: {'auction_closing_time': 1774875600.0, 'created_time': 1774648043.234492, 'last_price_update_time': 1774752362.19731}
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987849') HTTP/1.1" 204 0
2026-03-29 02:46:02 [ayvens.de] INFO: Found listing with ID: 1987850
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987850%27 HTTP/1.1" 200 None
2026-03-29 02:46:02 [ayvens.de] INFO: Scrape type for 1987850: 2
2026-03-29 02:46:02 [ayvens.de] INFO: Extracting data for car ID: 1987850
2026-03-29 02:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850
2026-03-29 02:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6f661b-12a1-5dae-9017-57d0280de01d with scrape type 2
2026-03-29 02:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6f661b-12a1-5dae-9017-57d0280de01d with scrape type 2
2026-03-29 02:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8b6f661b-12a1-5dae-9017-57d0280de01d, identifier: 1987850
2026-03-29 02:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850
2026-03-29 02:46:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850
2026-03-29 02:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850 to the API
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Shooting Star Grey Matt',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '8b6f661b-12a1-5dae-9017-57d0280de01d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ 5',
 'odometer': 40924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 5 HYUNDAI IONIQ 5 72,6 kWh Uniq Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI IONIQ 5 72,6 kWh Uniq Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987850%27 HTTP/1.1" 200 None
2026-03-29 02:46:02 [ayvens.de] INFO: Saving data for 1987850: {'auction_closing_time': 1774875600.0, 'created_time': 1774648042.487325, 'last_price_update_time': 1774752362.598579}
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987850') HTTP/1.1" 204 0
2026-03-29 02:46:02 [ayvens.de] INFO: Found listing with ID: 1987851
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987851%27 HTTP/1.1" 200 None
2026-03-29 02:46:02 [ayvens.de] INFO: Scrape type for 1987851: 2
2026-03-29 02:46:02 [ayvens.de] INFO: Extracting data for car ID: 1987851
2026-03-29 02:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851
2026-03-29 02:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f60e58-3849-5a74-9c83-c3d136a11dbe with scrape type 2
2026-03-29 02:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30f60e58-3849-5a74-9c83-c3d136a11dbe with scrape type 2
2026-03-29 02:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 30f60e58-3849-5a74-9c83-c3d136a11dbe, identifier: 1987851
2026-03-29 02:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851
2026-03-29 02:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851
2026-03-29 02:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851 to the API
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '30f60e58-3849-5a74-9c83-c3d136a11dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ Elektro',
 'odometer': 186427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ Elektro HYUNDAI IONIQ Elektro Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI IONIQ Elektro Limousine, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987851%27 HTTP/1.1" 200 None
2026-03-29 02:46:03 [ayvens.de] INFO: Saving data for 1987851: {'auction_closing_time': 1774875600.0, 'created_time': 1774648041.756244, 'last_price_update_time': 1774752363.009446}
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987851') HTTP/1.1" 204 0
2026-03-29 02:46:03 [ayvens.de] INFO: Found listing with ID: 1987852
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987852%27 HTTP/1.1" 200 None
2026-03-29 02:46:03 [ayvens.de] INFO: Scrape type for 1987852: 2
2026-03-29 02:46:03 [ayvens.de] INFO: Extracting data for car ID: 1987852
2026-03-29 02:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852
2026-03-29 02:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e14295-530f-55f8-87f7-0d32e8dc73f8 with scrape type 2
2026-03-29 02:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e14295-530f-55f8-87f7-0d32e8dc73f8 with scrape type 2
2026-03-29 02:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 23e14295-530f-55f8-87f7-0d32e8dc73f8, identifier: 1987852
2026-03-29 02:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852
2026-03-29 02:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852
2026-03-29 02:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852 to the API
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '23e14295-530f-55f8-87f7-0d32e8dc73f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ Elektro',
 'odometer': 64667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ Elektro HYUNDAI IONIQ Elektro Style Limousine, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI IONIQ Elektro Style Limousine, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987852%27 HTTP/1.1" 200 None
2026-03-29 02:46:03 [ayvens.de] INFO: Saving data for 1987852: {'auction_closing_time': 1774875600.0, 'created_time': 1774648015.983905, 'last_price_update_time': 1774752363.398905}
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987852') HTTP/1.1" 204 0
2026-03-29 02:46:03 [ayvens.de] INFO: Found listing with ID: 1987853
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987853%27 HTTP/1.1" 200 None
2026-03-29 02:46:03 [ayvens.de] INFO: Scrape type for 1987853: 2
2026-03-29 02:46:03 [ayvens.de] INFO: Extracting data for car ID: 1987853
2026-03-29 02:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853
2026-03-29 02:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99bfe01-6906-5fdc-84db-f363ac460d37 with scrape type 2
2026-03-29 02:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d99bfe01-6906-5fdc-84db-f363ac460d37 with scrape type 2
2026-03-29 02:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d99bfe01-6906-5fdc-84db-f363ac460d37, identifier: 1987853
2026-03-29 02:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853
2026-03-29 02:46:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853
2026-03-29 02:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853 to the API
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'd99bfe01-6906-5fdc-84db-f363ac460d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 167524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI Kona EV Premium Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Kona EV Premium Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987853%27 HTTP/1.1" 200 None
2026-03-29 02:46:03 [ayvens.de] INFO: Saving data for 1987853: {'auction_closing_time': 1774875600.0, 'created_time': 1774648041.054605, 'last_price_update_time': 1774752363.806999}
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987853') HTTP/1.1" 204 0
2026-03-29 02:46:03 [ayvens.de] INFO: Found listing with ID: 1987854
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987854%27 HTTP/1.1" 200 None
2026-03-29 02:46:03 [ayvens.de] INFO: Scrape type for 1987854: 2
2026-03-29 02:46:03 [ayvens.de] INFO: Extracting data for car ID: 1987854
2026-03-29 02:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854
2026-03-29 02:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with scrape type 2
2026-03-29 02:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with scrape type 2
2026-03-29 02:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48, identifier: 1987854
2026-03-29 02:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854
2026-03-29 02:46:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854
2026-03-29 02:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854 to the API
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Rot',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '62a6d7c5-ab94-5f66-bd3c-81c59ca02f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 135959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE HYUNDAI Santa Fe 2.2 CRDi 4WD Prime Geschlossen, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI Santa Fe 2.2 CRDi 4WD Prime Geschlossen, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987854%27 HTTP/1.1" 200 None
2026-03-29 02:46:04 [ayvens.de] INFO: Saving data for 1987854: {'auction_closing_time': 1774875600.0, 'created_time': 1774648040.313042, 'last_price_update_time': 1774752364.234417}
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987854') HTTP/1.1" 204 0
2026-03-29 02:46:04 [ayvens.de] INFO: Found listing with ID: 1987855
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987855%27 HTTP/1.1" 200 None
2026-03-29 02:46:04 [ayvens.de] INFO: Scrape type for 1987855: 2
2026-03-29 02:46:04 [ayvens.de] INFO: Extracting data for car ID: 1987855
2026-03-29 02:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855
2026-03-29 02:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad735daa-64f2-5158-bbd7-735033b779e0 with scrape type 2
2026-03-29 02:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad735daa-64f2-5158-bbd7-735033b779e0 with scrape type 2
2026-03-29 02:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ad735daa-64f2-5158-bbd7-735033b779e0, identifier: 1987855
2026-03-29 02:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855
2026-03-29 02:46:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855
2026-03-29 02:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855 to the API
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'ad735daa-64f2-5158-bbd7-735033b779e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 76313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2024}
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987855%27 HTTP/1.1" 200 None
2026-03-29 02:46:04 [ayvens.de] INFO: Saving data for 1987855: {'auction_closing_time': 1774875600.0, 'created_time': 1774648039.910096, 'last_price_update_time': 1774752364.676671}
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987855') HTTP/1.1" 204 0
2026-03-29 02:46:04 [ayvens.de] INFO: Found listing with ID: 1987856
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987856%27 HTTP/1.1" 200 None
2026-03-29 02:46:04 [ayvens.de] INFO: Scrape type for 1987856: 2
2026-03-29 02:46:04 [ayvens.de] INFO: Extracting data for car ID: 1987856
2026-03-29 02:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856
2026-03-29 02:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fe916e-ba37-57f7-a117-ab85c99b4909 with scrape type 2
2026-03-29 02:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fe916e-ba37-57f7-a117-ab85c99b4909 with scrape type 2
2026-03-29 02:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 98fe916e-ba37-57f7-a117-ab85c99b4909, identifier: 1987856
2026-03-29 02:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856
2026-03-29 02:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856
2026-03-29 02:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856 to the API
2026-03-29 02:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '98fe916e-ba37-57f7-a117-ab85c99b4909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 78335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2024}
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987856%27 HTTP/1.1" 200 None
2026-03-29 02:46:05 [ayvens.de] INFO: Saving data for 1987856: {'auction_closing_time': 1774875600.0, 'created_time': 1774648038.817569, 'last_price_update_time': 1774752365.18306}
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987856') HTTP/1.1" 204 0
2026-03-29 02:46:05 [ayvens.de] INFO: Found listing with ID: 1987857
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987857%27 HTTP/1.1" 200 None
2026-03-29 02:46:05 [ayvens.de] INFO: Scrape type for 1987857: 2
2026-03-29 02:46:05 [ayvens.de] INFO: Extracting data for car ID: 1987857
2026-03-29 02:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857
2026-03-29 02:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with scrape type 2
2026-03-29 02:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with scrape type 2
2026-03-29 02:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0, identifier: 1987857
2026-03-29 02:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857
2026-03-29 02:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857
2026-03-29 02:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857 to the API
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '8c1ed930-f72a-55f2-b4bf-73a0a808d9b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 75557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2024}
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987857%27 HTTP/1.1" 200 None
2026-03-29 02:46:05 [ayvens.de] INFO: Saving data for 1987857: {'auction_closing_time': 1774875600.0, 'created_time': 1774648038.129958, 'last_price_update_time': 1774752365.576956}
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987857') HTTP/1.1" 204 0
2026-03-29 02:46:05 [ayvens.de] INFO: Found listing with ID: 1987769
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987769%27 HTTP/1.1" 200 None
2026-03-29 02:46:05 [ayvens.de] INFO: Scrape type for 1987769: 2
2026-03-29 02:46:05 [ayvens.de] INFO: Extracting data for car ID: 1987769
2026-03-29 02:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769
2026-03-29 02:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 with scrape type 2
2026-03-29 02:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 with scrape type 2
2026-03-29 02:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1d0b11ee-57df-5dad-930b-9ad6cb904314, identifier: 1987769
2026-03-29 02:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769
2026-03-29 02:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769
2026-03-29 02:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769 to the API
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d0b11ee-57df-5dad-930b-9ad6cb904314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 29241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo BLUE dCi 80 START Kombi, 5-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo BLUE dCi 80 START Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987769%27 HTTP/1.1" 200 None
2026-03-29 02:46:05 [ayvens.de] INFO: Saving data for 1987769: {'auction_closing_time': 1774872000.0, 'created_time': 1774648037.46844, 'last_price_update_time': 1774752365.960423}
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987769') HTTP/1.1" 204 0
2026-03-29 02:46:05 [ayvens.de] INFO: Found listing with ID: 1987770
2026-03-29 02:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987770%27 HTTP/1.1" 200 None
2026-03-29 02:46:06 [ayvens.de] INFO: Scrape type for 1987770: 2
2026-03-29 02:46:06 [ayvens.de] INFO: Extracting data for car ID: 1987770
2026-03-29 02:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770
2026-03-29 02:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 2
2026-03-29 02:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 2
2026-03-29 02:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e43e99e6-fda1-5f2a-bce1-1804c47092dd, identifier: 1987770
2026-03-29 02:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770
2026-03-29 02:46:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770
2026-03-29 02:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770 to the API
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Polarwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e43e99e6-fda1-5f2a-bce1-1804c47092dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 48484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG '
          'Line Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG Line Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987770%27 HTTP/1.1" 200 None
2026-03-29 02:46:06 [ayvens.de] INFO: Saving data for 1987770: {'auction_closing_time': 1774872000.0, 'created_time': 1774648022.85581, 'last_price_update_time': 1774752366.396673}
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987770') HTTP/1.1" 204 0
2026-03-29 02:46:06 [ayvens.de] INFO: Found listing with ID: 1987771
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987771%27 HTTP/1.1" 200 None
2026-03-29 02:46:06 [ayvens.de] INFO: Scrape type for 1987771: 2
2026-03-29 02:46:06 [ayvens.de] INFO: Extracting data for car ID: 1987771
2026-03-29 02:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771
2026-03-29 02:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 2
2026-03-29 02:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 2
2026-03-29 02:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e731dd25-76e8-5724-931b-52a262f9cb61, identifier: 1987771
2026-03-29 02:46:06 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 81 items (at 81 items/min)
2026-03-29 02:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 167MiB
2026-03-29 02:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771
2026-03-29 02:46:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771
2026-03-29 02:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771 to the API
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e731dd25-76e8-5724-931b-52a262f9cb61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 80099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987771%27 HTTP/1.1" 200 None
2026-03-29 02:46:06 [ayvens.de] INFO: Saving data for 1987771: {'auction_closing_time': 1774872000.0, 'created_time': 1774648036.412624, 'last_price_update_time': 1774752366.820095}
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987771') HTTP/1.1" 204 0
2026-03-29 02:46:06 [ayvens.de] INFO: Found listing with ID: 1987772
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987772%27 HTTP/1.1" 200 None
2026-03-29 02:46:06 [ayvens.de] INFO: Scrape type for 1987772: 2
2026-03-29 02:46:06 [ayvens.de] INFO: Extracting data for car ID: 1987772
2026-03-29 02:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772
2026-03-29 02:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 2
2026-03-29 02:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 2
2026-03-29 02:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 11342670-1c07-51fa-9975-7777a82b441e, identifier: 1987772
2026-03-29 02:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772
2026-03-29 02:46:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772
2026-03-29 02:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772 to the API
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '11342670-1c07-51fa-9975-7777a82b441e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Megane',
 'odometer': 109877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Megane RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS '
          'Kombi, 5-türig, Automatik, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS Kombi, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987772%27 HTTP/1.1" 200 None
2026-03-29 02:46:07 [ayvens.de] INFO: Saving data for 1987772: {'auction_closing_time': 1774872000.0, 'created_time': 1774648026.197929, 'last_price_update_time': 1774752367.232461}
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987772') HTTP/1.1" 204 0
2026-03-29 02:46:07 [ayvens.de] INFO: Found listing with ID: 1987773
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987773%27 HTTP/1.1" 200 None
2026-03-29 02:46:07 [ayvens.de] INFO: Scrape type for 1987773: 2
2026-03-29 02:46:07 [ayvens.de] INFO: Extracting data for car ID: 1987773
2026-03-29 02:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773
2026-03-29 02:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 2
2026-03-29 02:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 2
2026-03-29 02:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e9ac5b8f-83b7-5935-9efe-bd6038786488, identifier: 1987773
2026-03-29 02:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773
2026-03-29 02:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773
2026-03-29 02:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773 to the API
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9ac5b8f-83b7-5935-9efe-bd6038786488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 43283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987773%27 HTTP/1.1" 200 None
2026-03-29 02:46:07 [ayvens.de] INFO: Saving data for 1987773: {'auction_closing_time': 1774872000.0, 'created_time': 1774648035.404286, 'last_price_update_time': 1774752367.713545}
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987773') HTTP/1.1" 204 0
2026-03-29 02:46:07 [ayvens.de] INFO: Found listing with ID: 1987774
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987774%27 HTTP/1.1" 200 None
2026-03-29 02:46:07 [ayvens.de] INFO: Scrape type for 1987774: 2
2026-03-29 02:46:07 [ayvens.de] INFO: Extracting data for car ID: 1987774
2026-03-29 02:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774
2026-03-29 02:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 2
2026-03-29 02:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 2
2026-03-29 02:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e6d4fbc8-7897-53cb-88cc-9c02768efdf3, identifier: 1987774
2026-03-29 02:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774
2026-03-29 02:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774
2026-03-29 02:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774 to the API
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e6d4fbc8-7897-53cb-88cc-9c02768efdf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 63566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987774%27 HTTP/1.1" 200 None
2026-03-29 02:46:08 [ayvens.de] INFO: Saving data for 1987774: {'auction_closing_time': 1774872000.0, 'created_time': 1774648035.723083, 'last_price_update_time': 1774752368.109076}
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987774') HTTP/1.1" 204 0
2026-03-29 02:46:08 [ayvens.de] INFO: Found listing with ID: 1987775
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987775%27 HTTP/1.1" 200 None
2026-03-29 02:46:08 [ayvens.de] INFO: Scrape type for 1987775: 2
2026-03-29 02:46:08 [ayvens.de] INFO: Extracting data for car ID: 1987775
2026-03-29 02:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775
2026-03-29 02:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 2
2026-03-29 02:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 2
2026-03-29 02:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f61061d5-b02f-5a06-9fae-2f2407055e5e, identifier: 1987775
2026-03-29 02:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775
2026-03-29 02:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775
2026-03-29 02:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775 to the API
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f61061d5-b02f-5a06-9fae-2f2407055e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 37443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987775%27 HTTP/1.1" 200 None
2026-03-29 02:46:08 [ayvens.de] INFO: Saving data for 1987775: {'auction_closing_time': 1774872000.0, 'created_time': 1774648034.549185, 'last_price_update_time': 1774752368.488678}
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987775') HTTP/1.1" 204 0
2026-03-29 02:46:08 [ayvens.de] INFO: Found listing with ID: 1987776
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987776%27 HTTP/1.1" 200 None
2026-03-29 02:46:08 [ayvens.de] INFO: Scrape type for 1987776: 2
2026-03-29 02:46:08 [ayvens.de] INFO: Extracting data for car ID: 1987776
2026-03-29 02:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776
2026-03-29 02:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 2
2026-03-29 02:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 2
2026-03-29 02:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: da284d19-31cb-5c93-9976-fd28ea9fe5bd, identifier: 1987776
2026-03-29 02:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776
2026-03-29 02:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776
2026-03-29 02:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776 to the API
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'na',
 'id': 'da284d19-31cb-5c93-9976-fd28ea9fe5bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 141479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987776%27 HTTP/1.1" 200 None
2026-03-29 02:46:08 [ayvens.de] INFO: Saving data for 1987776: {'auction_closing_time': 1774872000.0, 'created_time': 1774648033.772079, 'last_price_update_time': 1774752368.882414}
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987776') HTTP/1.1" 204 0
2026-03-29 02:46:08 [ayvens.de] INFO: Found listing with ID: 1987777
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987777%27 HTTP/1.1" 200 None
2026-03-29 02:46:08 [ayvens.de] INFO: Scrape type for 1987777: 2
2026-03-29 02:46:08 [ayvens.de] INFO: Extracting data for car ID: 1987777
2026-03-29 02:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777
2026-03-29 02:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 2
2026-03-29 02:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 2
2026-03-29 02:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2, identifier: 1987777
2026-03-29 02:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777
2026-03-29 02:46:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-29 02:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777
2026-03-29 02:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777 to the API
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'na',
 'id': '34e4ce32-4ccd-5eaa-8527-6989631e5ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'DS7',
 'odometer': 159688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN DS7 CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE '
          'LINE + Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE LINE + '
         'Geschlossen, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987777%27 HTTP/1.1" 200 None
2026-03-29 02:46:09 [ayvens.de] INFO: Saving data for 1987777: {'auction_closing_time': 1774872000.0, 'created_time': 1774648033.079119, 'last_price_update_time': 1774752369.278566}
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987777') HTTP/1.1" 204 0
2026-03-29 02:46:09 [ayvens.de] INFO: Found listing with ID: 1987778
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987778%27 HTTP/1.1" 200 None
2026-03-29 02:46:09 [ayvens.de] INFO: Scrape type for 1987778: 2
2026-03-29 02:46:09 [ayvens.de] INFO: Extracting data for car ID: 1987778
2026-03-29 02:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778
2026-03-29 02:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3139121-61f7-5733-97da-8f11b6a26a67 with scrape type 2
2026-03-29 02:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3139121-61f7-5733-97da-8f11b6a26a67 with scrape type 2
2026-03-29 02:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d3139121-61f7-5733-97da-8f11b6a26a67, identifier: 1987778
2026-03-29 02:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778
2026-03-29 02:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778
2026-03-29 02:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778 to the API
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 02:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3139121-61f7-5733-97da-8f11b6a26a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mondeo',
 'odometer': 92195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mondeo FORD Mondeo Turnier 2.0 EcoBlue Aut. Titanium Kombi, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Mondeo Turnier 2.0 EcoBlue Aut. Titanium Kombi, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987778%27 HTTP/1.1" 200 None
2026-03-29 02:46:09 [ayvens.de] INFO: Saving data for 1987778: {'auction_closing_time': 1774872000.0, 'created_time': 1774648032.363251, 'last_price_update_time': 1774752369.778441}
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987778') HTTP/1.1" 204 0
2026-03-29 02:46:09 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-29 02:46:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 02:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-29 02:46:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 02:46:11 [ayvens.de] INFO: ayvens.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20last_price_update_time%20lt%201774320371 HTTP/1.1" 200 None
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977099') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977100') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977101') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977102') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977103') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977104') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977105') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977106') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977107') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977108') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977109') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977110') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977277') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977278') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977279') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977280') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977281') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977282') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977283') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977284') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977285') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977286') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977287') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977288') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977289') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977290') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977291') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977292') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977293') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977294') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977295') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977296') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977297') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977298') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977299') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977300') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977301') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977302') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977303') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977304') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977305') HTTP/1.1" 204 0
2026-03-29 02:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977306') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977307') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977308') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977309') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977310') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977311') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977312') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977313') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977314') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977315') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977316') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977317') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977318') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977319') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977320') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977321') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977322') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977323') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977324') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977325') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977326') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977327') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977328') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977329') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977330') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977331') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977332') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977333') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977334') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977335') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977336') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977337') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977338') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977339') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977340') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977341') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977342') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977343') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977344') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977345') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977346') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977347') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977348') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977349') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977350') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977351') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977352') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977353') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977354') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977355') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977356') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977357') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977358') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977359') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977360') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977361') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977362') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977363') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977364') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977365') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977366') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977367') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977368') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977369') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977370') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977371') HTTP/1.1" 204 0
2026-03-29 02:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1977372') HTTP/1.1" 204 0
2026-03-29 02:46:12 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (89 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.de/task_43_2026-03-29T02_45_00.jl
2026-03-29 02:46:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 3410,
 'downloader/request_count': 3,
 'downloader/request_method_count/GET': 1,
 'downloader/request_method_count/POST': 2,
 'downloader/response_bytes': 699130,
 'downloader/response_count': 3,
 'downloader/response_status_count/200': 3,
 'elapsed_time_seconds': 66.232813,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 2, 46, 12, 611318, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 89,
 'log_count/DEBUG': 1241,
 'log_count/INFO': 1074,
 'memusage/max': 175206400,
 'memusage/startup': 147861504,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 138,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 134,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 6,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 27,
 'playwright/request_count/resource_type/script': 81,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 118,
 'playwright/response_count/method/GET': 115,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 5,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 10,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 2,
 'response_received_count': 3,
 'scheduler/dequeued': 3,
 'scheduler/dequeued/memory': 3,
 'scheduler/enqueued': 3,
 'scheduler/enqueued/memory': 3,
 'scrape_type/price_update': 89,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 2,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.3611439056694508,
 'scrapy-zyte-api/mean_response_seconds': 3.4255573246628046,
 'scrapy-zyte-api/processed': 2,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 2,
 'scrapy-zyte-api/request_args/httpRequestBody': 2,
 'scrapy-zyte-api/request_args/httpRequestMethod': 2,
 'scrapy-zyte-api/request_args/httpResponseBody': 2,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
 'scrapy-zyte-api/request_args/url': 2,
 'scrapy-zyte-api/status_codes/200': 2,
 'scrapy-zyte-api/success': 2,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 29, 2, 45, 6, 378505, tzinfo=datetime.timezone.utc)}
2026-03-29 02:46:12 [scrapy.core.engine] INFO: Spider closed (finished)