2026-03-24 18:30:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-24 18:30:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-24 18:30:04 [ayvens.es] INFO: Starting spider ayvens.es
2026-03-24 18:30:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-24 18:30:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-24 18:30:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-24 18:30:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-24 18:30:05 [scrapy.extensions.telnet] INFO: Telnet Password: 516bc02c442ae46b
2026-03-24 18:30:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-24 18:30:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.es/task_38_2026-03-24T18_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-24 18:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 18:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 18:30:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-24 18:30:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-24 18:30:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-24 18:30:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-24 18:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 18:30:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-24 18:30:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-24 18:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-24 18:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-24 18:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-24 18:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-24 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-24 18:30:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-24 18:30:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-24 18:30:05 [scrapy.core.engine] INFO: Spider opened
2026-03-24 18:30:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-24 18:30:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-24 18:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-24 18:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-24 18:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-24 18:30:10 [scrapy-playwright] INFO: Launching browser firefox
2026-03-24 18:30:10 [scrapy-playwright] INFO: Browser firefox launched
2026-03-24 18:30:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-24 18:30:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-24 18:30:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 18:30:11 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 18:30:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-24 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 18:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 18:30:17 [ayvens.es] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': '+EeiYEAujSWbQulwujzf9H|2026-03-24T18:30:15.399Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1805913015, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'vVIlFV1xuGjBY0NGR60CVB|1774377016740|1774377016740', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774378816, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-24 18:30:17 [ayvens.es] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': '+EeiYEAujSWbQulwujzf9H|2026-03-24T18:30:15.399Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'vVIlFV1xuGjBY0NGR60CVB|1774377016740|1774377016740', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-24 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-24 18:30:17 [ayvens.es] INFO: Intercepting token...
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-24 18:30:17 [ayvens.es] INFO: Scrolling element to trigger lazy load...
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://api-carmarket.ayvens.com/graphql/saleevents>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/reset.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/dk.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/reset.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/camera-icon.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/dk.svg>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-24 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/it.svg>
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/dz1/5817e94b4ed34ca3847359f1533e6284/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/x9g/6047cafd5846484589c7792ee2749b69/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/17d12d4fa9fe48ada70a2825dbcb6371/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/14149de2c8884698904b9bc6c94912c9/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/dz1/5817e94b4ed34ca3847359f1533e6284/images/medium/0.jpg>
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/gj6/14149de2c8884698904b9bc6c94912c9/images/medium/0.jpg>
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-24 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/gl4/17d12d4fa9fe48ada70a2825dbcb6371/images/medium/0.jpg>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/x9g/6047cafd5846484589c7792ee2749b69/images/medium/0.jpg>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/medium/0.jpg>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/medium/0.jpg>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg>
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png>
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/powered_by_logo.svg>
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744>
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c&gtm=4e63n0> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c&gtm=4e63n0> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c&gtm=4e63n0>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c&gtm=4e63n0>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=8258760566135;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_PCRy5y0-s1azjkB9OuEC1cEYugBshUw9pA;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=8258760566135;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_PCRy5y0-s1azjkB9OuEC1cEYugBshUw9pA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=8768640545467;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_sIhI15RdYP2TlxmTxdp9w4c74Jq0P-lVoQ;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=8768640545467;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_sIhI15RdYP2TlxmTxdp9w4c74Jq0P-lVoQ;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=6283442281504;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_AOkxyci63zSX_STmkqy31T97AZib643fTw;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=6283442281504;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_AOkxyci63zSX_STmkqy31T97AZib643fTw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/commons.1818bf8cd18dc6e0da8b.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [ayvens.es] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd/main.3e1b06697792eb1071c8.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/me.42217d3094fdefbb5607.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/jquery.5434730a34a3135b52f6.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://region1.analytics.google.com/g/collect?v=2&tid=G-2R31MHSGCW&gtm=45je63n0v877189330z877415155za20gzb77415155zd77415155&_p=1774377019882&_gaz=1&gcd=13l3l3l3l1l1&npa=0&dma=0&cid=941937384.1774377021&ul=en-us&sr=1280x720&frm=0&pscdl=noapi&_eu=AAAAAGA&_s=1&tag_exp=103116026~103200004~115938465~115938469~116024733~117484252~117512543&sid=1774377021&sct=1&seg=0&dl=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots&dt=Used%20cars%20lots%20for%20sale%20-%20car%20auctions%20for%20dealers%20and%20traders%20%7C%20Ayvens%20Carmarket&_tu=KA&en=lots_page_view&_fv=1&_nsi=1&_ss=1&ep.site_country_event=gbr&ep.user_country_event=&ep.environment_event=prd&ep.page_name_event=%2Fen-gb%2Flots&ep.error_code_event=&ep.contains_error_event=false&ep.contains_user_info_event=false&ep.language_event=eng&ep.sale_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20null&ep.ic_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined&epn.countdown_event=478782&up.user_country=&up.contains_user_info=false&up.language=eng&tfd=9589> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://stats.g.doubleclick.net/g/collect?v=2&tid=G-2R31MHSGCW&cid=941937384.1774377021&gtm=45je63n0v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=103116026~103200004~115938465~115938469~116024733~117484252~117512543> (resource type: other, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-2R31MHSGCW&cid=941937384.1774377021&gtm=45je63n0v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=103116026~103200004~115938465~115938469~116024733~117484252~117512543&z=233551819> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=8258760566135;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=11;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_PCRy5y0-s1azjkB9OuEC1cEYugBshUw9pA;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/commons.1818bf8cd18dc6e0da8b.js>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd/main.3e1b06697792eb1071c8.js>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/me.42217d3094fdefbb5607.js>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/jquery.5434730a34a3135b52f6.js>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/analytics.acdad3b7e7c480ec6fa6.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://dcinfos-cache.abtasty.com/v1/ua-parser> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd/950819.1185133.json?6bef836bfb20069192f6dae669f10ca8> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/analytics.acdad3b7e7c480ec6fa6.js>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd/950819.1185133.json?6bef836bfb20069192f6dae669f10ca8>
2026-03-24 18:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=6283442281504;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_AOkxyci63zSX_STmkqy31T97AZib643fTw;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=8768640545467;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_sIhI15RdYP2TlxmTxdp9w4c74Jq0P-lVoQ;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=8258760566135;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=11;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_PCRy5y0-s1azjkB9OuEC1cEYugBshUw9pA;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=8768640545467;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_sIhI15RdYP2TlxmTxdp9w4c74Jq0P-lVoQ;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=8768640545467;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_sIhI15RdYP2TlxmTxdp9w4c74Jq0P-lVoQ;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots> (resource type: image, referrer: https://4340043.fls.doubleclick.net/)
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-2R31MHSGCW&cid=941937384.1774377021&gtm=45je63n0v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=103116026~103200004~115938465~115938469~116024733~117484252~117512543&z=233551819>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dcinfos-cache.abtasty.com/v1/ua-parser>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <204 https://stats.g.doubleclick.net/g/collect?v=2&tid=G-2R31MHSGCW&cid=941937384.1774377021&gtm=45je63n0v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=103116026~103200004~115938465~115938469~116024733~117484252~117512543>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <204 https://region1.analytics.google.com/g/collect?v=2&tid=G-2R31MHSGCW&gtm=45je63n0v877189330z877415155za20gzb77415155zd77415155&_p=1774377019882&_gaz=1&gcd=13l3l3l3l1l1&npa=0&dma=0&cid=941937384.1774377021&ul=en-us&sr=1280x720&frm=0&pscdl=noapi&_eu=AAAAAGA&_s=1&tag_exp=103116026~103200004~115938465~115938469~116024733~117484252~117512543&sid=1774377021&sct=1&seg=0&dl=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots&dt=Used%20cars%20lots%20for%20sale%20-%20car%20auctions%20for%20dealers%20and%20traders%20%7C%20Ayvens%20Carmarket&_tu=KA&en=lots_page_view&_fv=1&_nsi=1&_ss=1&ep.site_country_event=gbr&ep.user_country_event=&ep.environment_event=prd&ep.page_name_event=%2Fen-gb%2Flots&ep.error_code_event=&ep.contains_error_event=false&ep.contains_user_info_event=false&ep.language_event=eng&ep.sale_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20null&ep.ic_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined&epn.countdown_event=478782&up.user_country=&up.contains_user_info=false&up.language=eng&tfd=9589>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=6283442281504;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_AOkxyci63zSX_STmkqy31T97AZib643fTw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=6283442281504;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_AOkxyci63zSX_STmkqy31T97AZib643fTw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots> (resource type: image, referrer: https://4340043.fls.doubleclick.net/)
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=8258760566135;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=720268199.1774377021;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_PCRy5y0-s1azjkB9OuEC1cEYugBshUw9pA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?>
2026-03-24 18:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=8258760566135;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_PCRy5y0-s1azjkB9OuEC1cEYugBshUw9pA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots> (resource type: image, referrer: https://4340043.fls.doubleclick.net/)
2026-03-24 18:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=6283442281504;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_AOkxyci63zSX_STmkqy31T97AZib643fTw;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots>
2026-03-24 18:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://adservice.google.com/ddm/fls/z/src=4340043;type=aldcar;cat=aldca0;ord=8258760566135;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=*;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63n0v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~115938465~115938468~116024733~117484252~118131588;epver=2;dc_random=1774377021_PCRy5y0-s1azjkB9OuEC1cEYugBshUw9pA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots>
2026-03-24 18:30:23 [ayvens.es] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-24 18:30:23 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-24 18:30:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 18:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981022
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981022%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981022: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981022
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42bf00a7-82c2-58c0-b144-89b8da2f4d52 with identifier: 1981022
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42bf00a7-82c2-58c0-b144-89b8da2f4d52 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 42bf00a7-82c2-58c0-b144-89b8da2f4d52
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252Faf75774a536c4a2f812b6d68992fea7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/af75774a536c4a2f812b6d68992fea7f/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981023
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981023%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981023: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981023
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f01f25-268c-56e2-89cd-b31dae3f8108 with identifier: 1981023
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f01f25-268c-56e2-89cd-b31dae3f8108 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 04f01f25-268c-56e2-89cd-b31dae3f8108
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252F3a0660ed47484bde82a951955137b2c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/3a0660ed47484bde82a951955137b2c3/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981024
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981024%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981024: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981024
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e30ee99-5359-5983-800f-f5711e99514b with identifier: 1981024
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e30ee99-5359-5983-800f-f5711e99514b with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e30ee99-5359-5983-800f-f5711e99514b
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F923%252F7b28e645fb3a4f5f866c91262dcc6783%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/923/7b28e645fb3a4f5f866c91262dcc6783/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981025
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981025%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981025: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981025
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09cd47cc-83e0-534a-b9c9-fc279b1e211e with identifier: 1981025
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09cd47cc-83e0-534a-b9c9-fc279b1e211e with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09cd47cc-83e0-534a-b9c9-fc279b1e211e
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F304%252F6bf0101247fd4a9184a8e6b7293473fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/304/6bf0101247fd4a9184a8e6b7293473fb/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981026
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981026%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981026: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981026
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1981026
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3723815-fb0a-51ad-9544-bd6f97a71365 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3723815-fb0a-51ad-9544-bd6f97a71365
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F622%252F683f83c7d4184a82b3d30f5fc1775704%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/622/683f83c7d4184a82b3d30f5fc1775704/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981027
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981027%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981027: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981027
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1981027
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F0e75b18d537e4426aed75e42b4242d4f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/0e75b18d537e4426aed75e42b4242d4f/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981028
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981028%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981028: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981028
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1981028
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d62bdd-18b7-5645-bfab-780d1c00700e with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6d62bdd-18b7-5645-bfab-780d1c00700e
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252F8561cbe36d6045db8b5f22eafd80785c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/8561cbe36d6045db8b5f22eafd80785c/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981029
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981029%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981029: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981029
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1981029
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6fd490-7526-505f-9ec0-407c8e277878 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cf6fd490-7526-505f-9ec0-407c8e277878
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F301%252F775c94b424d44e839c95e1a6b4b42116%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/301/775c94b424d44e839c95e1a6b4b42116/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981030
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981030%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981030: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981030
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8 with identifier: 1981030
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252F2bf946f4f4c24f7bb6846db2d0feae75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/2bf946f4f4c24f7bb6846db2d0feae75/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981031
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981031%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981031: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981031
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1981031
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252Fd9ad635a38c14a60a28e774aa9f5291d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/d9ad635a38c14a60a28e774aa9f5291d/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981032
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981032%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981032: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981032
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1981032
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252Fa855a748253c4b9a9f65f0ab87fe4591%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/a855a748253c4b9a9f65f0ab87fe4591/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981033
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981033%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981033: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981033
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 303362ca-e3d0-5252-8602-9238e3a6e4e3 with identifier: 1981033
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 303362ca-e3d0-5252-8602-9238e3a6e4e3 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 303362ca-e3d0-5252-8602-9238e3a6e4e3
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F2f4f7610a1064d34be7a91b82246291a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/2f4f7610a1064d34be7a91b82246291a/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981034
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981034%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981034: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981034
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2ca05a-6ae5-5148-815f-a018921b1486 with identifier: 1981034
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2ca05a-6ae5-5148-815f-a018921b1486 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b2ca05a-6ae5-5148-815f-a018921b1486
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F915%252Fe1b668b99e5b46dcbf9b811f324cadc5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/915/e1b668b99e5b46dcbf9b811f324cadc5/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981035
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981035%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981035: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981035
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989ff7d3-0e72-502a-b242-a1a1e58bef29 with identifier: 1981035
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989ff7d3-0e72-502a-b242-a1a1e58bef29 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 989ff7d3-0e72-502a-b242-a1a1e58bef29
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F152%252Fef563dfd4eb14b5cb07651635011ba58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/152/ef563dfd4eb14b5cb07651635011ba58/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981036
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981036%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981036: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981036
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afb616ce-8e3e-511c-8545-3f49e3614d85 with identifier: 1981036
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb616ce-8e3e-511c-8545-3f49e3614d85 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afb616ce-8e3e-511c-8545-3f49e3614d85
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F827%252F381ec7fa94504c58bca6c78358542162%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/827/381ec7fa94504c58bca6c78358542162/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981037
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981037%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981037: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981037
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1981037
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252Ff4eb1f1e8ed7422fae681669bf0b40da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/f4eb1f1e8ed7422fae681669bf0b40da/images/large/1.jpg not downloaded yet
2026-03-24 18:30:25 [ayvens.es] INFO: Found listing with ID: 1981038
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981038%27 HTTP/1.1" 200 None
2026-03-24 18:30:25 [ayvens.es] INFO: Scrape type for 1981038: 1
2026-03-24 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1981038
2026-03-24 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1981038
2026-03-24 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f60e9c0f-10fc-5274-8c05-0a26a334eb91 with scrape type 1
2026-03-24 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f60e9c0f-10fc-5274-8c05-0a26a334eb91
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F479%252F8c5ad989323e4b4a9aa3bb4c7caa72f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/479/8c5ad989323e4b4a9aa3bb4c7caa72f6/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [ayvens.es] INFO: Found listing with ID: 1981039
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981039%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [ayvens.es] INFO: Scrape type for 1981039: 1
2026-03-24 18:30:26 [ayvens.es] INFO: Extracting data for car ID: 1981039
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c90d692-dde2-5890-b4e6-b4473169458d with identifier: 1981039
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c90d692-dde2-5890-b4e6-b4473169458d with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8c90d692-dde2-5890-b4e6-b4473169458d
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F526%252F1d6ea23f21af49e58c83631ebd74f1f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/526/1d6ea23f21af49e58c83631ebd74f1f4/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [ayvens.es] INFO: Found listing with ID: 1981040
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981040%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [ayvens.es] INFO: Scrape type for 1981040: 1
2026-03-24 18:30:26 [ayvens.es] INFO: Extracting data for car ID: 1981040
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ee2efd-6b63-535c-a84e-4129b63e4d4a with identifier: 1981040
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ee2efd-6b63-535c-a84e-4129b63e4d4a with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 91ee2efd-6b63-535c-a84e-4129b63e4d4a
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F166%252F43bb66a3a4904aaf9a761515222e3ec5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/166/43bb66a3a4904aaf9a761515222e3ec5/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/923/7b28e645fb3a4f5f866c91262dcc6783/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:26 [ayvens.es] INFO: Found listing with ID: 1981041
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981041%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [ayvens.es] INFO: Scrape type for 1981041: 1
2026-03-24 18:30:26 [ayvens.es] INFO: Extracting data for car ID: 1981041
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf14e60-62f9-557a-aaf3-2e0dfc5892fa with identifier: 1981041
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf14e60-62f9-557a-aaf3-2e0dfc5892fa with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dcf14e60-62f9-557a-aaf3-2e0dfc5892fa
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252F6c192dcb09e5430689553ebfea680c42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/6c192dcb09e5430689553ebfea680c42/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/402/3a0660ed47484bde82a951955137b2c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:26 [ayvens.es] INFO: Found listing with ID: 1981042
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981042%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [ayvens.es] INFO: Scrape type for 1981042: 1
2026-03-24 18:30:26 [ayvens.es] INFO: Extracting data for car ID: 1981042
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e7eb45-93a0-5325-814f-74cd7da03a8a with identifier: 1981042
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e7eb45-93a0-5325-814f-74cd7da03a8a with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 95e7eb45-93a0-5325-814f-74cd7da03a8a
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F136%252F0bece2e69a0943c4ab04a80b7153d2be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/136/0bece2e69a0943c4ab04a80b7153d2be/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [ayvens.es] INFO: Found listing with ID: 1981043
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981043%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [ayvens.es] INFO: Scrape type for 1981043: 1
2026-03-24 18:30:26 [ayvens.es] INFO: Extracting data for car ID: 1981043
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 858d8c80-b59b-57e2-ad40-2d03335d1bff with identifier: 1981043
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858d8c80-b59b-57e2-ad40-2d03335d1bff with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 858d8c80-b59b-57e2-ad40-2d03335d1bff
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F862%252F82a153059710446790402b5b10a49922%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/862/82a153059710446790402b5b10a49922/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/304/6bf0101247fd4a9184a8e6b7293473fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:26 [ayvens.es] INFO: Found listing with ID: 1981044
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981044%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [ayvens.es] INFO: Scrape type for 1981044: 1
2026-03-24 18:30:26 [ayvens.es] INFO: Extracting data for car ID: 1981044
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5 with identifier: 1981044
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5 with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252Fa09e08ae0b5347ef9b26a187e92d87aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/a09e08ae0b5347ef9b26a187e92d87aa/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-24 18:30:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-24 18:30:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7fb090>
2026-03-24 18:30:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e30ee99-5359-5983-800f-f5711e99514b/0e30ee99-5359-5983-800f-f5711e99514b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F923%252F7b28e645fb3a4f5f866c91262dcc6783%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/923/7b28e645fb3a4f5f866c91262dcc6783/images/large/1.jpg saved to cache
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e30ee99-5359-5983-800f-f5711e99514b
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e30ee99-5359-5983-800f-f5711e99514b, skipping ID generation
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e30ee99-5359-5983-800f-f5711e99514b with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e30ee99-5359-5983-800f-f5711e99514b sending to next pipeline
2026-03-24 18:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e30ee99-5359-5983-800f-f5711e99514b, identifier: 1981024
2026-03-24 18:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/622/683f83c7d4184a82b3d30f5fc1775704/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:26 [ayvens.es] INFO: Found listing with ID: 1981045
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981045%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [ayvens.es] INFO: Scrape type for 1981045: 1
2026-03-24 18:30:26 [ayvens.es] INFO: Extracting data for car ID: 1981045
2026-03-24 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a52e2b4-d786-5aa4-8385-eb13b66b9f82 with identifier: 1981045
2026-03-24 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a52e2b4-d786-5aa4-8385-eb13b66b9f82 with scrape type 1
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4a52e2b4-d786-5aa4-8385-eb13b66b9f82
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F743%252F535e76b1e9264b2fa717c1d999e78a0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/743/535e76b1e9264b2fa717c1d999e78a0a/images/large/1.jpg not downloaded yet
2026-03-24 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e30ee99-5359-5983-800f-f5711e99514b with identifier: 1981024
2026-03-24 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e30ee99-5359-5983-800f-f5711e99514b with identifier: 1981024
2026-03-24 18:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e30ee99-5359-5983-800f-f5711e99514b with identifier: 1981024 to the API
2026-03-24 18:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/923/7b28e645fb3a4f5f866c91262dcc6783/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e30ee99-5359-5983-800f-f5711e99514b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 157379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e30ee99-5359-5983-800f-f5711e99514b/0e30ee99-5359-5983-800f-f5711e99514b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/923/7b28e645fb3a4f5f866c91262dcc6783/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2017}
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981024%27 HTTP/1.1" 200 None
2026-03-24 18:30:28 [ayvens.es] INFO: Saving data for 1981024: {'created_time': 1774377028.415896, 'last_price_update_time': 1774377028.415907, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981024') HTTP/1.1" 204 0
2026-03-24 18:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6de990>
2026-03-24 18:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f01f25-268c-56e2-89cd-b31dae3f8108/04f01f25-268c-56e2-89cd-b31dae3f8108_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252F3a0660ed47484bde82a951955137b2c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/3a0660ed47484bde82a951955137b2c3/images/large/1.jpg saved to cache
2026-03-24 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04f01f25-268c-56e2-89cd-b31dae3f8108
2026-03-24 18:30:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04f01f25-268c-56e2-89cd-b31dae3f8108, skipping ID generation
2026-03-24 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f01f25-268c-56e2-89cd-b31dae3f8108 with scrape type 1
2026-03-24 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04f01f25-268c-56e2-89cd-b31dae3f8108 sending to next pipeline
2026-03-24 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 04f01f25-268c-56e2-89cd-b31dae3f8108, identifier: 1981023
2026-03-24 18:30:28 [ayvens.es] INFO: Found listing with ID: 1981046
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981046%27 HTTP/1.1" 200 None
2026-03-24 18:30:28 [ayvens.es] INFO: Scrape type for 1981046: 1
2026-03-24 18:30:28 [ayvens.es] INFO: Extracting data for car ID: 1981046
2026-03-24 18:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 701bb2de-d432-5b3d-83b3-82c266dabbd9 with identifier: 1981046
2026-03-24 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701bb2de-d432-5b3d-83b3-82c266dabbd9 with scrape type 1
2026-03-24 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 701bb2de-d432-5b3d-83b3-82c266dabbd9
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F572%252Fd89eb6b6e2d349f7b9aef3b12d310f4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/572/d89eb6b6e2d349f7b9aef3b12d310f4c/images/large/1.jpg not downloaded yet
2026-03-24 18:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 04f01f25-268c-56e2-89cd-b31dae3f8108 with identifier: 1981023
2026-03-24 18:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 04f01f25-268c-56e2-89cd-b31dae3f8108 with identifier: 1981023
2026-03-24 18:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 04f01f25-268c-56e2-89cd-b31dae3f8108 with identifier: 1981023 to the API
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/402/3a0660ed47484bde82a951955137b2c3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '04f01f25-268c-56e2-89cd-b31dae3f8108',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 16411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f01f25-268c-56e2-89cd-b31dae3f8108/04f01f25-268c-56e2-89cd-b31dae3f8108_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/402/3a0660ed47484bde82a951955137b2c3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L2H1 Energy BluedCi 70 kW',
 'transmission': 'manual',
 'trim': 'Furgon 29 L2H1 Energy BluedCi 70 kW',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981023%27 HTTP/1.1" 200 None
2026-03-24 18:30:29 [ayvens.es] INFO: Saving data for 1981023: {'created_time': 1774377029.070175, 'last_price_update_time': 1774377029.070187, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981023') HTTP/1.1" 204 0
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7bae10>
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09cd47cc-83e0-534a-b9c9-fc279b1e211e/09cd47cc-83e0-534a-b9c9-fc279b1e211e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F304%252F6bf0101247fd4a9184a8e6b7293473fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/304/6bf0101247fd4a9184a8e6b7293473fb/images/large/1.jpg saved to cache
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09cd47cc-83e0-534a-b9c9-fc279b1e211e
2026-03-24 18:30:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09cd47cc-83e0-534a-b9c9-fc279b1e211e, skipping ID generation
2026-03-24 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09cd47cc-83e0-534a-b9c9-fc279b1e211e with scrape type 1
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09cd47cc-83e0-534a-b9c9-fc279b1e211e sending to next pipeline
2026-03-24 18:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 09cd47cc-83e0-534a-b9c9-fc279b1e211e, identifier: 1981025
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee823810>
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3723815-fb0a-51ad-9544-bd6f97a71365/b3723815-fb0a-51ad-9544-bd6f97a71365_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F622%252F683f83c7d4184a82b3d30f5fc1775704%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/622/683f83c7d4184a82b3d30f5fc1775704/images/large/1.jpg saved to cache
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3723815-fb0a-51ad-9544-bd6f97a71365
2026-03-24 18:30:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3723815-fb0a-51ad-9544-bd6f97a71365, skipping ID generation
2026-03-24 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3723815-fb0a-51ad-9544-bd6f97a71365 with scrape type 1
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3723815-fb0a-51ad-9544-bd6f97a71365 sending to next pipeline
2026-03-24 18:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b3723815-fb0a-51ad-9544-bd6f97a71365, identifier: 1981026
2026-03-24 18:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/613/8561cbe36d6045db8b5f22eafd80785c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:29 [ayvens.es] INFO: Found listing with ID: 1981047
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981047%27 HTTP/1.1" 200 None
2026-03-24 18:30:29 [ayvens.es] INFO: Scrape type for 1981047: 1
2026-03-24 18:30:29 [ayvens.es] INFO: Extracting data for car ID: 1981047
2026-03-24 18:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ba1731-3528-5f32-b700-e342e7e0df5c with identifier: 1981047
2026-03-24 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ba1731-3528-5f32-b700-e342e7e0df5c with scrape type 1
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1ba1731-3528-5f32-b700-e342e7e0df5c
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F8bdec5d4fa454fb280ab85bf7a63bd69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/8bdec5d4fa454fb280ab85bf7a63bd69/images/large/1.jpg not downloaded yet
2026-03-24 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 09cd47cc-83e0-534a-b9c9-fc279b1e211e with identifier: 1981025
2026-03-24 18:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 09cd47cc-83e0-534a-b9c9-fc279b1e211e with identifier: 1981025
2026-03-24 18:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 09cd47cc-83e0-534a-b9c9-fc279b1e211e with identifier: 1981025 to the API
2026-03-24 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/304/6bf0101247fd4a9184a8e6b7293473fb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '09cd47cc-83e0-534a-b9c9-fc279b1e211e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 150354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09cd47cc-83e0-534a-b9c9-fc279b1e211e/09cd47cc-83e0-534a-b9c9-fc279b1e211e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/304/6bf0101247fd4a9184a8e6b7293473fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD RANGER 2.2 TDCi 160cv 4x4 Cab. Sencilla XL S/S',
 'transmission': 'manual',
 'trim': '2.2 TDCi 160cv 4x4 Cab. Sencilla XL S/S',
 'vin': None,
 'year': 2016}
2026-03-24 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981025%27 HTTP/1.1" 200 None
2026-03-24 18:30:30 [ayvens.es] INFO: Saving data for 1981025: {'created_time': 1774377030.825853, 'last_price_update_time': 1774377030.825868, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981025') HTTP/1.1" 204 0
2026-03-24 18:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1981026
2026-03-24 18:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1981026
2026-03-24 18:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1981026 to the API
2026-03-24 18:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/622/683f83c7d4184a82b3d30f5fc1775704/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3723815-fb0a-51ad-9544-bd6f97a71365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 159673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3723815-fb0a-51ad-9544-bd6f97a71365/b3723815-fb0a-51ad-9544-bd6f97a71365_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/622/683f83c7d4184a82b3d30f5fc1775704/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981026%27 HTTP/1.1" 200 None
2026-03-24 18:30:31 [ayvens.es] INFO: Saving data for 1981026: {'created_time': 1774377031.209328, 'last_price_update_time': 1774377031.209339, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981026') HTTP/1.1" 204 0
2026-03-24 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/705/af75774a536c4a2f812b6d68992fea7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/651/0e75b18d537e4426aed75e42b4242d4f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:31 [ayvens.es] INFO: Found listing with ID: 1981048
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981048%27 HTTP/1.1" 200 None
2026-03-24 18:30:31 [ayvens.es] INFO: Scrape type for 1981048: 1
2026-03-24 18:30:31 [ayvens.es] INFO: Extracting data for car ID: 1981048
2026-03-24 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1981048
2026-03-24 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335d649b-7a33-582f-b16b-21d6f5329660 with scrape type 1
2026-03-24 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 335d649b-7a33-582f-b16b-21d6f5329660
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F730%252F559650b3705b48cbb32a222887cdd488%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/730/559650b3705b48cbb32a222887cdd488/images/large/1.jpg not downloaded yet
2026-03-24 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/d9ad635a38c14a60a28e774aa9f5291d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/301/775c94b424d44e839c95e1a6b4b42116/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/188/2bf946f4f4c24f7bb6846db2d0feae75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/933/2f4f7610a1064d34be7a91b82246291a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:31 [ayvens.es] INFO: Found listing with ID: 1981049
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981049%27 HTTP/1.1" 200 None
2026-03-24 18:30:31 [ayvens.es] INFO: Scrape type for 1981049: 1
2026-03-24 18:30:31 [ayvens.es] INFO: Extracting data for car ID: 1981049
2026-03-24 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ede593f-cf24-5905-83c9-f800bb7fa168 with identifier: 1981049
2026-03-24 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ede593f-cf24-5905-83c9-f800bb7fa168 with scrape type 1
2026-03-24 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ede593f-cf24-5905-83c9-f800bb7fa168
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F742%252Fd23962a1223442aeb9b5a3ae0961b180%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/742/d23962a1223442aeb9b5a3ae0961b180/images/large/1.jpg not downloaded yet
2026-03-24 18:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee84f150>
2026-03-24 18:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d62bdd-18b7-5645-bfab-780d1c00700e/d6d62bdd-18b7-5645-bfab-780d1c00700e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252F8561cbe36d6045db8b5f22eafd80785c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/8561cbe36d6045db8b5f22eafd80785c/images/large/1.jpg saved to cache
2026-03-24 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d62bdd-18b7-5645-bfab-780d1c00700e
2026-03-24 18:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d62bdd-18b7-5645-bfab-780d1c00700e, skipping ID generation
2026-03-24 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d62bdd-18b7-5645-bfab-780d1c00700e with scrape type 1
2026-03-24 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d62bdd-18b7-5645-bfab-780d1c00700e sending to next pipeline
2026-03-24 18:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6d62bdd-18b7-5645-bfab-780d1c00700e, identifier: 1981028
2026-03-24 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/420/a855a748253c4b9a9f65f0ab87fe4591/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1981028
2026-03-24 18:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1981028
2026-03-24 18:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1981028 to the API
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/613/8561cbe36d6045db8b5f22eafd80785c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6d62bdd-18b7-5645-bfab-780d1c00700e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 152507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d62bdd-18b7-5645-bfab-780d1c00700e/d6d62bdd-18b7-5645-bfab-780d1c00700e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/613/8561cbe36d6045db8b5f22eafd80785c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981028%27 HTTP/1.1" 200 None
2026-03-24 18:30:32 [ayvens.es] INFO: Saving data for 1981028: {'created_time': 1774377032.511723, 'last_price_update_time': 1774377032.511734, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981028') HTTP/1.1" 204 0
2026-03-24 18:30:32 [ayvens.es] INFO: Found listing with ID: 1981050
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981050%27 HTTP/1.1" 200 None
2026-03-24 18:30:32 [ayvens.es] INFO: Scrape type for 1981050: 1
2026-03-24 18:30:32 [ayvens.es] INFO: Extracting data for car ID: 1981050
2026-03-24 18:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526 with identifier: 1981050
2026-03-24 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526 with scrape type 1
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F618%252F0d08dd1bed224db48a92af4c330014ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/618/0d08dd1bed224db48a92af4c330014ea/images/large/1.jpg not downloaded yet
2026-03-24 18:30:32 [ayvens.es] INFO: Found listing with ID: 1981051
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981051%27 HTTP/1.1" 200 None
2026-03-24 18:30:32 [ayvens.es] INFO: Scrape type for 1981051: 1
2026-03-24 18:30:32 [ayvens.es] INFO: Extracting data for car ID: 1981051
2026-03-24 18:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351e9346-81dd-59bc-a3cd-d5a037d88c8c with identifier: 1981051
2026-03-24 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351e9346-81dd-59bc-a3cd-d5a037d88c8c with scrape type 1
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 351e9346-81dd-59bc-a3cd-d5a037d88c8c
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F433%252F333a72161fe44d26b27a887e7c4e0076%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/433/333a72161fe44d26b27a887e7c4e0076/images/large/1.jpg not downloaded yet
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee947f50>
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42bf00a7-82c2-58c0-b144-89b8da2f4d52/42bf00a7-82c2-58c0-b144-89b8da2f4d52_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252Faf75774a536c4a2f812b6d68992fea7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/af75774a536c4a2f812b6d68992fea7f/images/large/1.jpg saved to cache
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42bf00a7-82c2-58c0-b144-89b8da2f4d52
2026-03-24 18:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42bf00a7-82c2-58c0-b144-89b8da2f4d52, skipping ID generation
2026-03-24 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42bf00a7-82c2-58c0-b144-89b8da2f4d52 with scrape type 1
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42bf00a7-82c2-58c0-b144-89b8da2f4d52 sending to next pipeline
2026-03-24 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 42bf00a7-82c2-58c0-b144-89b8da2f4d52, identifier: 1981022
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee231810>
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70/6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F0e75b18d537e4426aed75e42b4242d4f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/0e75b18d537e4426aed75e42b4242d4f/images/large/1.jpg saved to cache
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70
2026-03-24 18:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70, skipping ID generation
2026-03-24 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with scrape type 1
2026-03-24 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 sending to next pipeline
2026-03-24 18:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70, identifier: 1981027
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e5210>
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50e3fa5-f539-5efc-aac6-20ae6ed274d8/c50e3fa5-f539-5efc-aac6-20ae6ed274d8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252Fd9ad635a38c14a60a28e774aa9f5291d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/d9ad635a38c14a60a28e774aa9f5291d/images/large/1.jpg saved to cache
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8
2026-03-24 18:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c50e3fa5-f539-5efc-aac6-20ae6ed274d8, skipping ID generation
2026-03-24 18:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with scrape type 1
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8 sending to next pipeline
2026-03-24 18:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c50e3fa5-f539-5efc-aac6-20ae6ed274d8, identifier: 1981031
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee84c6d0>
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6fd490-7526-505f-9ec0-407c8e277878/cf6fd490-7526-505f-9ec0-407c8e277878_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F301%252F775c94b424d44e839c95e1a6b4b42116%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/301/775c94b424d44e839c95e1a6b4b42116/images/large/1.jpg saved to cache
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf6fd490-7526-505f-9ec0-407c8e277878
2026-03-24 18:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf6fd490-7526-505f-9ec0-407c8e277878, skipping ID generation
2026-03-24 18:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6fd490-7526-505f-9ec0-407c8e277878 with scrape type 1
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf6fd490-7526-505f-9ec0-407c8e277878 sending to next pipeline
2026-03-24 18:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cf6fd490-7526-505f-9ec0-407c8e277878, identifier: 1981029
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee84c6d0>
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8/c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252F2bf946f4f4c24f7bb6846db2d0feae75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/2bf946f4f4c24f7bb6846db2d0feae75/images/large/1.jpg saved to cache
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8
2026-03-24 18:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8, skipping ID generation
2026-03-24 18:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8 with scrape type 1
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8 sending to next pipeline
2026-03-24 18:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8, identifier: 1981030
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e3050>
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_303362ca-e3d0-5252-8602-9238e3a6e4e3/303362ca-e3d0-5252-8602-9238e3a6e4e3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F2f4f7610a1064d34be7a91b82246291a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/2f4f7610a1064d34be7a91b82246291a/images/large/1.jpg saved to cache
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 303362ca-e3d0-5252-8602-9238e3a6e4e3
2026-03-24 18:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 303362ca-e3d0-5252-8602-9238e3a6e4e3, skipping ID generation
2026-03-24 18:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 303362ca-e3d0-5252-8602-9238e3a6e4e3 with scrape type 1
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 303362ca-e3d0-5252-8602-9238e3a6e4e3 sending to next pipeline
2026-03-24 18:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 303362ca-e3d0-5252-8602-9238e3a6e4e3, identifier: 1981033
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee977b90>
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd68a749-4dbd-5b28-a0dd-c1b268cab7e7/cd68a749-4dbd-5b28-a0dd-c1b268cab7e7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252Fa855a748253c4b9a9f65f0ab87fe4591%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/a855a748253c4b9a9f65f0ab87fe4591/images/large/1.jpg saved to cache
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7
2026-03-24 18:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7, skipping ID generation
2026-03-24 18:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with scrape type 1
2026-03-24 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 sending to next pipeline
2026-03-24 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7, identifier: 1981032
2026-03-24 18:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/915/e1b668b99e5b46dcbf9b811f324cadc5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:34 [ayvens.es] INFO: Found listing with ID: 1981052
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981052%27 HTTP/1.1" 200 None
2026-03-24 18:30:34 [ayvens.es] INFO: Scrape type for 1981052: 1
2026-03-24 18:30:34 [ayvens.es] INFO: Extracting data for car ID: 1981052
2026-03-24 18:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88d7a975-3e6b-53f0-be44-2ca8eb474607 with identifier: 1981052
2026-03-24 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d7a975-3e6b-53f0-be44-2ca8eb474607 with scrape type 1
2026-03-24 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88d7a975-3e6b-53f0-be44-2ca8eb474607
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F662%252Fa76248b132cf44dfaa059ff83ae90c68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/662/a76248b132cf44dfaa059ff83ae90c68/images/large/1.jpg not downloaded yet
2026-03-24 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 42bf00a7-82c2-58c0-b144-89b8da2f4d52 with identifier: 1981022
2026-03-24 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 42bf00a7-82c2-58c0-b144-89b8da2f4d52 with identifier: 1981022
2026-03-24 18:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 42bf00a7-82c2-58c0-b144-89b8da2f4d52 with identifier: 1981022 to the API
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/705/af75774a536c4a2f812b6d68992fea7f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '42bf00a7-82c2-58c0-b144-89b8da2f4d52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 149563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42bf00a7-82c2-58c0-b144-89b8da2f4d52/42bf00a7-82c2-58c0-b144-89b8da2f4d52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/705/af75774a536c4a2f812b6d68992fea7f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 66kW (90CV) E6',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 66kW (90CV) E6',
 'vin': None,
 'year': 2018}
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981022%27 HTTP/1.1" 200 None
2026-03-24 18:30:34 [ayvens.es] INFO: Saving data for 1981022: {'created_time': 1774377034.53645, 'last_price_update_time': 1774377034.536462, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981022') HTTP/1.1" 204 0
2026-03-24 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1981027
2026-03-24 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1981027
2026-03-24 18:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1981027 to the API
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/651/0e75b18d537e4426aed75e42b4242d4f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 126956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70/6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/651/0e75b18d537e4426aed75e42b4242d4f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981027%27 HTTP/1.1" 200 None
2026-03-24 18:30:34 [ayvens.es] INFO: Saving data for 1981027: {'created_time': 1774377034.946697, 'last_price_update_time': 1774377034.946708, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981027') HTTP/1.1" 204 0
2026-03-24 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1981031
2026-03-24 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1981031
2026-03-24 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1981031 to the API
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/d9ad635a38c14a60a28e774aa9f5291d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c50e3fa5-f539-5efc-aac6-20ae6ed274d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 218645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50e3fa5-f539-5efc-aac6-20ae6ed274d8/c50e3fa5-f539-5efc-aac6-20ae6ed274d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/d9ad635a38c14a60a28e774aa9f5291d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 dCi 88kW (120CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 dCi 88kW (120CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981031%27 HTTP/1.1" 200 None
2026-03-24 18:30:35 [ayvens.es] INFO: Saving data for 1981031: {'created_time': 1774377035.259036, 'last_price_update_time': 1774377035.25905, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981031') HTTP/1.1" 204 0
2026-03-24 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1981029
2026-03-24 18:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1981029
2026-03-24 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1981029 to the API
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/301/775c94b424d44e839c95e1a6b4b42116/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cf6fd490-7526-505f-9ec0-407c8e277878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 266224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6fd490-7526-505f-9ec0-407c8e277878/cf6fd490-7526-505f-9ec0-407c8e277878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/301/775c94b424d44e839c95e1a6b4b42116/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981029%27 HTTP/1.1" 200 None
2026-03-24 18:30:35 [ayvens.es] INFO: Saving data for 1981029: {'created_time': 1774377035.567003, 'last_price_update_time': 1774377035.567013, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981029') HTTP/1.1" 204 0
2026-03-24 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8 with identifier: 1981030
2026-03-24 18:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8 with identifier: 1981030
2026-03-24 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8 with identifier: 1981030 to the API
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/188/2bf946f4f4c24f7bb6846db2d0feae75/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 258004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8/c6a6ffe3-5bfd-5d2b-8fc2-b2a608dc58b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/188/2bf946f4f4c24f7bb6846db2d0feae75/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2+++Revisar peritacion+++',
 'vin': None,
 'year': 2016}
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981030%27 HTTP/1.1" 200 None
2026-03-24 18:30:35 [ayvens.es] INFO: Saving data for 1981030: {'created_time': 1774377035.864647, 'last_price_update_time': 1774377035.864661, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981030') HTTP/1.1" 204 0
2026-03-24 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 303362ca-e3d0-5252-8602-9238e3a6e4e3 with identifier: 1981033
2026-03-24 18:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 303362ca-e3d0-5252-8602-9238e3a6e4e3 with identifier: 1981033
2026-03-24 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 303362ca-e3d0-5252-8602-9238e3a6e4e3 with identifier: 1981033 to the API
2026-03-24 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/933/2f4f7610a1064d34be7a91b82246291a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '303362ca-e3d0-5252-8602-9238e3a6e4e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 149391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303362ca-e3d0-5252-8602-9238e3a6e4e3/303362ca-e3d0-5252-8602-9238e3a6e4e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/933/2f4f7610a1064d34be7a91b82246291a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981033%27 HTTP/1.1" 200 None
2026-03-24 18:30:36 [ayvens.es] INFO: Saving data for 1981033: {'created_time': 1774377036.175215, 'last_price_update_time': 1774377036.175226, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981033') HTTP/1.1" 204 0
2026-03-24 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1981032
2026-03-24 18:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1981032
2026-03-24 18:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1981032 to the API
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/420/a855a748253c4b9a9f65f0ab87fe4591/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cd68a749-4dbd-5b28-a0dd-c1b268cab7e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 135753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd68a749-4dbd-5b28-a0dd-c1b268cab7e7/cd68a749-4dbd-5b28-a0dd-c1b268cab7e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/420/a855a748253c4b9a9f65f0ab87fe4591/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981032%27 HTTP/1.1" 200 None
2026-03-24 18:30:36 [ayvens.es] INFO: Saving data for 1981032: {'created_time': 1774377036.493125, 'last_price_update_time': 1774377036.493134, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981032') HTTP/1.1" 204 0
2026-03-24 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/827/381ec7fa94504c58bca6c78358542162/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/862/82a153059710446790402b5b10a49922/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/255/f4eb1f1e8ed7422fae681669bf0b40da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/166/43bb66a3a4904aaf9a761515222e3ec5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/019/6c192dcb09e5430689553ebfea680c42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:36 [ayvens.es] INFO: Found listing with ID: 1981053
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981053%27 HTTP/1.1" 200 None
2026-03-24 18:30:36 [ayvens.es] INFO: Scrape type for 1981053: 1
2026-03-24 18:30:36 [ayvens.es] INFO: Extracting data for car ID: 1981053
2026-03-24 18:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1981053
2026-03-24 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab06b5df-22a6-501a-bb3f-83990d1d6957 with scrape type 1
2026-03-24 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab06b5df-22a6-501a-bb3f-83990d1d6957
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F133%252F8736de6463bc4aa9a383877b797f838b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/133/8736de6463bc4aa9a383877b797f838b/images/large/1.jpg not downloaded yet
2026-03-24 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/152/ef563dfd4eb14b5cb07651635011ba58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:36 [ayvens.es] INFO: Found listing with ID: 1981054
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981054%27 HTTP/1.1" 200 None
2026-03-24 18:30:36 [ayvens.es] INFO: Scrape type for 1981054: 1
2026-03-24 18:30:36 [ayvens.es] INFO: Extracting data for car ID: 1981054
2026-03-24 18:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aa3f072-9ae5-5928-943c-f48af6d4577a with identifier: 1981054
2026-03-24 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa3f072-9ae5-5928-943c-f48af6d4577a with scrape type 1
2026-03-24 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3aa3f072-9ae5-5928-943c-f48af6d4577a
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252Fad18a195e1d64aa48cf0f762e30df1e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/ad18a195e1d64aa48cf0f762e30df1e0/images/large/1.jpg not downloaded yet
2026-03-24 18:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e2690>
2026-03-24 18:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ca05a-6ae5-5148-815f-a018921b1486/9b2ca05a-6ae5-5148-815f-a018921b1486_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F915%252Fe1b668b99e5b46dcbf9b811f324cadc5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/915/e1b668b99e5b46dcbf9b811f324cadc5/images/large/1.jpg saved to cache
2026-03-24 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b2ca05a-6ae5-5148-815f-a018921b1486
2026-03-24 18:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b2ca05a-6ae5-5148-815f-a018921b1486, skipping ID generation
2026-03-24 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2ca05a-6ae5-5148-815f-a018921b1486 with scrape type 1
2026-03-24 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b2ca05a-6ae5-5148-815f-a018921b1486 sending to next pipeline
2026-03-24 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b2ca05a-6ae5-5148-815f-a018921b1486, identifier: 1981034
2026-03-24 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b2ca05a-6ae5-5148-815f-a018921b1486 with identifier: 1981034
2026-03-24 18:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b2ca05a-6ae5-5148-815f-a018921b1486 with identifier: 1981034
2026-03-24 18:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b2ca05a-6ae5-5148-815f-a018921b1486 with identifier: 1981034 to the API
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/915/e1b668b99e5b46dcbf9b811f324cadc5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9b2ca05a-6ae5-5148-815f-a018921b1486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 128585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ca05a-6ae5-5148-815f-a018921b1486/9b2ca05a-6ae5-5148-815f-a018921b1486_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/915/e1b668b99e5b46dcbf9b811f324cadc5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981034%27 HTTP/1.1" 200 None
2026-03-24 18:30:37 [ayvens.es] INFO: Saving data for 1981034: {'created_time': 1774377037.260019, 'last_price_update_time': 1774377037.260041, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981034') HTTP/1.1" 204 0
2026-03-24 18:30:37 [ayvens.es] INFO: Found listing with ID: 1981055
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981055%27 HTTP/1.1" 200 None
2026-03-24 18:30:37 [ayvens.es] INFO: Scrape type for 1981055: 1
2026-03-24 18:30:37 [ayvens.es] INFO: Extracting data for car ID: 1981055
2026-03-24 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1981055
2026-03-24 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with scrape type 1
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252Fa4a9aebc86394bd6941e8c16b67563d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/a4a9aebc86394bd6941e8c16b67563d2/images/large/1.jpg not downloaded yet
2026-03-24 18:30:37 [ayvens.es] INFO: Found listing with ID: 1981056
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981056%27 HTTP/1.1" 200 None
2026-03-24 18:30:37 [ayvens.es] INFO: Scrape type for 1981056: 1
2026-03-24 18:30:37 [ayvens.es] INFO: Extracting data for car ID: 1981056
2026-03-24 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1981056
2026-03-24 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78860afc-54ee-5779-ba9f-582d6ca4dace with scrape type 1
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 78860afc-54ee-5779-ba9f-582d6ca4dace
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252Fffad9308a0bf4618b6d4ae231c327f52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/ffad9308a0bf4618b6d4ae231c327f52/images/large/1.jpg not downloaded yet
2026-03-24 18:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/257/a09e08ae0b5347ef9b26a187e92d87aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb0b1d0>
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb616ce-8e3e-511c-8545-3f49e3614d85/afb616ce-8e3e-511c-8545-3f49e3614d85_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F827%252F381ec7fa94504c58bca6c78358542162%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/827/381ec7fa94504c58bca6c78358542162/images/large/1.jpg saved to cache
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afb616ce-8e3e-511c-8545-3f49e3614d85
2026-03-24 18:30:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afb616ce-8e3e-511c-8545-3f49e3614d85, skipping ID generation
2026-03-24 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb616ce-8e3e-511c-8545-3f49e3614d85 with scrape type 1
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afb616ce-8e3e-511c-8545-3f49e3614d85 sending to next pipeline
2026-03-24 18:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: afb616ce-8e3e-511c-8545-3f49e3614d85, identifier: 1981036
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91fee7e890>
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_858d8c80-b59b-57e2-ad40-2d03335d1bff/858d8c80-b59b-57e2-ad40-2d03335d1bff_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F862%252F82a153059710446790402b5b10a49922%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/862/82a153059710446790402b5b10a49922/images/large/1.jpg saved to cache
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 858d8c80-b59b-57e2-ad40-2d03335d1bff
2026-03-24 18:30:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 858d8c80-b59b-57e2-ad40-2d03335d1bff, skipping ID generation
2026-03-24 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858d8c80-b59b-57e2-ad40-2d03335d1bff with scrape type 1
2026-03-24 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 858d8c80-b59b-57e2-ad40-2d03335d1bff sending to next pipeline
2026-03-24 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 858d8c80-b59b-57e2-ad40-2d03335d1bff, identifier: 1981043
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6f51d0>
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_720b7807-d2a2-5991-ab3c-59ad1cdb2250/720b7807-d2a2-5991-ab3c-59ad1cdb2250_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252Ff4eb1f1e8ed7422fae681669bf0b40da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/f4eb1f1e8ed7422fae681669bf0b40da/images/large/1.jpg saved to cache
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250
2026-03-24 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 720b7807-d2a2-5991-ab3c-59ad1cdb2250, skipping ID generation
2026-03-24 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with scrape type 1
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250 sending to next pipeline
2026-03-24 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 720b7807-d2a2-5991-ab3c-59ad1cdb2250, identifier: 1981037
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e5210>
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91ee2efd-6b63-535c-a84e-4129b63e4d4a/91ee2efd-6b63-535c-a84e-4129b63e4d4a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F166%252F43bb66a3a4904aaf9a761515222e3ec5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/166/43bb66a3a4904aaf9a761515222e3ec5/images/large/1.jpg saved to cache
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91ee2efd-6b63-535c-a84e-4129b63e4d4a
2026-03-24 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91ee2efd-6b63-535c-a84e-4129b63e4d4a, skipping ID generation
2026-03-24 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ee2efd-6b63-535c-a84e-4129b63e4d4a with scrape type 1
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91ee2efd-6b63-535c-a84e-4129b63e4d4a sending to next pipeline
2026-03-24 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 91ee2efd-6b63-535c-a84e-4129b63e4d4a, identifier: 1981040
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb13410>
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf14e60-62f9-557a-aaf3-2e0dfc5892fa/dcf14e60-62f9-557a-aaf3-2e0dfc5892fa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252F6c192dcb09e5430689553ebfea680c42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/6c192dcb09e5430689553ebfea680c42/images/large/1.jpg saved to cache
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcf14e60-62f9-557a-aaf3-2e0dfc5892fa
2026-03-24 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcf14e60-62f9-557a-aaf3-2e0dfc5892fa, skipping ID generation
2026-03-24 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf14e60-62f9-557a-aaf3-2e0dfc5892fa with scrape type 1
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcf14e60-62f9-557a-aaf3-2e0dfc5892fa sending to next pipeline
2026-03-24 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dcf14e60-62f9-557a-aaf3-2e0dfc5892fa, identifier: 1981041
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee22c090>
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989ff7d3-0e72-502a-b242-a1a1e58bef29/989ff7d3-0e72-502a-b242-a1a1e58bef29_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F152%252Fef563dfd4eb14b5cb07651635011ba58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/152/ef563dfd4eb14b5cb07651635011ba58/images/large/1.jpg saved to cache
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 989ff7d3-0e72-502a-b242-a1a1e58bef29
2026-03-24 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 989ff7d3-0e72-502a-b242-a1a1e58bef29, skipping ID generation
2026-03-24 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989ff7d3-0e72-502a-b242-a1a1e58bef29 with scrape type 1
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 989ff7d3-0e72-502a-b242-a1a1e58bef29 sending to next pipeline
2026-03-24 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 989ff7d3-0e72-502a-b242-a1a1e58bef29, identifier: 1981035
2026-03-24 18:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/743/535e76b1e9264b2fa717c1d999e78a0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:38 [ayvens.es] INFO: Found listing with ID: 1981057
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981057%27 HTTP/1.1" 200 None
2026-03-24 18:30:38 [ayvens.es] INFO: Scrape type for 1981057: 1
2026-03-24 18:30:38 [ayvens.es] INFO: Extracting data for car ID: 1981057
2026-03-24 18:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1981057
2026-03-24 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with scrape type 1
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F37a30ac92c4544d093fcf48fb1a857d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/37a30ac92c4544d093fcf48fb1a857d9/images/large/1.jpg not downloaded yet
2026-03-24 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: afb616ce-8e3e-511c-8545-3f49e3614d85 with identifier: 1981036
2026-03-24 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: afb616ce-8e3e-511c-8545-3f49e3614d85 with identifier: 1981036
2026-03-24 18:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: afb616ce-8e3e-511c-8545-3f49e3614d85 with identifier: 1981036 to the API
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/827/381ec7fa94504c58bca6c78358542162/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'afb616ce-8e3e-511c-8545-3f49e3614d85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 97830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb616ce-8e3e-511c-8545-3f49e3614d85/afb616ce-8e3e-511c-8545-3f49e3614d85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/827/381ec7fa94504c58bca6c78358542162/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO (O) Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': '(O) Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981036%27 HTTP/1.1" 200 None
2026-03-24 18:30:39 [ayvens.es] INFO: Saving data for 1981036: {'created_time': 1774377039.226339, 'last_price_update_time': 1774377039.226352, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981036') HTTP/1.1" 204 0
2026-03-24 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 858d8c80-b59b-57e2-ad40-2d03335d1bff with identifier: 1981043
2026-03-24 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 858d8c80-b59b-57e2-ad40-2d03335d1bff with identifier: 1981043
2026-03-24 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 858d8c80-b59b-57e2-ad40-2d03335d1bff with identifier: 1981043 to the API
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/862/82a153059710446790402b5b10a49922/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '858d8c80-b59b-57e2-ad40-2d03335d1bff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 66283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_858d8c80-b59b-57e2-ad40-2d03335d1bff/858d8c80-b59b-57e2-ad40-2d03335d1bff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/862/82a153059710446790402b5b10a49922/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981043%27 HTTP/1.1" 200 None
2026-03-24 18:30:39 [ayvens.es] INFO: Saving data for 1981043: {'created_time': 1774377039.627725, 'last_price_update_time': 1774377039.627737, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981043') HTTP/1.1" 204 0
2026-03-24 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1981037
2026-03-24 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1981037
2026-03-24 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1981037 to the API
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/255/f4eb1f1e8ed7422fae681669bf0b40da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '720b7807-d2a2-5991-ab3c-59ad1cdb2250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 162969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_720b7807-d2a2-5991-ab3c-59ad1cdb2250/720b7807-d2a2-5991-ab3c-59ad1cdb2250_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/255/f4eb1f1e8ed7422fae681669bf0b40da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981037%27 HTTP/1.1" 200 None
2026-03-24 18:30:39 [ayvens.es] INFO: Saving data for 1981037: {'created_time': 1774377039.957209, 'last_price_update_time': 1774377039.957219, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981037') HTTP/1.1" 204 0
2026-03-24 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 91ee2efd-6b63-535c-a84e-4129b63e4d4a with identifier: 1981040
2026-03-24 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 91ee2efd-6b63-535c-a84e-4129b63e4d4a with identifier: 1981040
2026-03-24 18:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 91ee2efd-6b63-535c-a84e-4129b63e4d4a with identifier: 1981040 to the API
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/166/43bb66a3a4904aaf9a761515222e3ec5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '91ee2efd-6b63-535c-a84e-4129b63e4d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 121527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91ee2efd-6b63-535c-a84e-4129b63e4d4a/91ee2efd-6b63-535c-a84e-4129b63e4d4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/166/43bb66a3a4904aaf9a761515222e3ec5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981040%27 HTTP/1.1" 200 None
2026-03-24 18:30:40 [ayvens.es] INFO: Saving data for 1981040: {'created_time': 1774377040.27882, 'last_price_update_time': 1774377040.278832, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981040') HTTP/1.1" 204 0
2026-03-24 18:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dcf14e60-62f9-557a-aaf3-2e0dfc5892fa with identifier: 1981041
2026-03-24 18:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dcf14e60-62f9-557a-aaf3-2e0dfc5892fa with identifier: 1981041
2026-03-24 18:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dcf14e60-62f9-557a-aaf3-2e0dfc5892fa with identifier: 1981041 to the API
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/019/6c192dcb09e5430689553ebfea680c42/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dcf14e60-62f9-557a-aaf3-2e0dfc5892fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 69116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf14e60-62f9-557a-aaf3-2e0dfc5892fa/dcf14e60-62f9-557a-aaf3-2e0dfc5892fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/019/6c192dcb09e5430689553ebfea680c42/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO (O) Combi N1 SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': '(O) Combi N1 SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981041%27 HTTP/1.1" 200 None
2026-03-24 18:30:40 [ayvens.es] INFO: Saving data for 1981041: {'created_time': 1774377040.585048, 'last_price_update_time': 1774377040.585058, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981041') HTTP/1.1" 204 0
2026-03-24 18:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 989ff7d3-0e72-502a-b242-a1a1e58bef29 with identifier: 1981035
2026-03-24 18:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 989ff7d3-0e72-502a-b242-a1a1e58bef29 with identifier: 1981035
2026-03-24 18:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 989ff7d3-0e72-502a-b242-a1a1e58bef29 with identifier: 1981035 to the API
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/152/ef563dfd4eb14b5cb07651635011ba58/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '989ff7d3-0e72-502a-b242-a1a1e58bef29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 72128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989ff7d3-0e72-502a-b242-a1a1e58bef29/989ff7d3-0e72-502a-b242-a1a1e58bef29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/152/ef563dfd4eb14b5cb07651635011ba58/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981035%27 HTTP/1.1" 200 None
2026-03-24 18:30:40 [ayvens.es] INFO: Saving data for 1981035: {'created_time': 1774377040.899379, 'last_price_update_time': 1774377040.899389, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981035') HTTP/1.1" 204 0
2026-03-24 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/730/559650b3705b48cbb32a222887cdd488/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/136/0bece2e69a0943c4ab04a80b7153d2be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/781/8bdec5d4fa454fb280ab85bf7a63bd69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/479/8c5ad989323e4b4a9aa3bb4c7caa72f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/572/d89eb6b6e2d349f7b9aef3b12d310f4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:40 [ayvens.es] INFO: Found listing with ID: 1981058
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981058%27 HTTP/1.1" 200 None
2026-03-24 18:30:40 [ayvens.es] INFO: Scrape type for 1981058: 1
2026-03-24 18:30:40 [ayvens.es] INFO: Extracting data for car ID: 1981058
2026-03-24 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1981058
2026-03-24 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49d1e343-de0f-5488-929a-8ffb7f7e6389 with scrape type 1
2026-03-24 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49d1e343-de0f-5488-929a-8ffb7f7e6389
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F059%252Fe4ab9abb4c90484ab242daa732f3c524%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/059/e4ab9abb4c90484ab242daa732f3c524/images/large/1.jpg not downloaded yet
2026-03-24 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7c6f10>
2026-03-24 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5/ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252Fa09e08ae0b5347ef9b26a187e92d87aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/a09e08ae0b5347ef9b26a187e92d87aa/images/large/1.jpg saved to cache
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5
2026-03-24 18:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5, skipping ID generation
2026-03-24 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5 with scrape type 1
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5 sending to next pipeline
2026-03-24 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5, identifier: 1981044
2026-03-24 18:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/526/1d6ea23f21af49e58c83631ebd74f1f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5 with identifier: 1981044
2026-03-24 18:30:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5 with identifier: 1981044
2026-03-24 18:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5 with identifier: 1981044 to the API
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/257/a09e08ae0b5347ef9b26a187e92d87aa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Rojo vivo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 251181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5/ad35dcf2-ac93-5c1a-a311-d91d8af8b9f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/257/a09e08ae0b5347ef9b26a187e92d87aa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981044%27 HTTP/1.1" 200 None
2026-03-24 18:30:41 [ayvens.es] INFO: Saving data for 1981044: {'created_time': 1774377041.523007, 'last_price_update_time': 1774377041.523019, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981044') HTTP/1.1" 204 0
2026-03-24 18:30:41 [ayvens.es] INFO: Found listing with ID: 1981059
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981059%27 HTTP/1.1" 200 None
2026-03-24 18:30:41 [ayvens.es] INFO: Scrape type for 1981059: 1
2026-03-24 18:30:41 [ayvens.es] INFO: Extracting data for car ID: 1981059
2026-03-24 18:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3e25c1f-90d7-5b32-8441-e53caa748122 with identifier: 1981059
2026-03-24 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e25c1f-90d7-5b32-8441-e53caa748122 with scrape type 1
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3e25c1f-90d7-5b32-8441-e53caa748122
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F278%252Fab4416e958504aabbcc4832566142127%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/278/ab4416e958504aabbcc4832566142127/images/large/1.jpg not downloaded yet
2026-03-24 18:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8c8e10>
2026-03-24 18:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a52e2b4-d786-5aa4-8385-eb13b66b9f82/4a52e2b4-d786-5aa4-8385-eb13b66b9f82_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F743%252F535e76b1e9264b2fa717c1d999e78a0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/743/535e76b1e9264b2fa717c1d999e78a0a/images/large/1.jpg saved to cache
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a52e2b4-d786-5aa4-8385-eb13b66b9f82
2026-03-24 18:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a52e2b4-d786-5aa4-8385-eb13b66b9f82, skipping ID generation
2026-03-24 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a52e2b4-d786-5aa4-8385-eb13b66b9f82 with scrape type 1
2026-03-24 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a52e2b4-d786-5aa4-8385-eb13b66b9f82 sending to next pipeline
2026-03-24 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4a52e2b4-d786-5aa4-8385-eb13b66b9f82, identifier: 1981045
2026-03-24 18:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4a52e2b4-d786-5aa4-8385-eb13b66b9f82 with identifier: 1981045
2026-03-24 18:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4a52e2b4-d786-5aa4-8385-eb13b66b9f82 with identifier: 1981045
2026-03-24 18:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4a52e2b4-d786-5aa4-8385-eb13b66b9f82 with identifier: 1981045 to the API
2026-03-24 18:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/743/535e76b1e9264b2fa717c1d999e78a0a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4a52e2b4-d786-5aa4-8385-eb13b66b9f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 135801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a52e2b4-d786-5aa4-8385-eb13b66b9f82/4a52e2b4-d786-5aa4-8385-eb13b66b9f82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/743/535e76b1e9264b2fa717c1d999e78a0a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981045%27 HTTP/1.1" 200 None
2026-03-24 18:30:42 [ayvens.es] INFO: Saving data for 1981045: {'created_time': 1774377042.118818, 'last_price_update_time': 1774377042.118829, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981045') HTTP/1.1" 204 0
2026-03-24 18:30:42 [ayvens.es] INFO: Found listing with ID: 1981060
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981060%27 HTTP/1.1" 200 None
2026-03-24 18:30:42 [ayvens.es] INFO: Scrape type for 1981060: 1
2026-03-24 18:30:42 [ayvens.es] INFO: Extracting data for car ID: 1981060
2026-03-24 18:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1981060
2026-03-24 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f3fce2-0a28-5258-ab85-933a3018e8a1 with scrape type 1
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62f3fce2-0a28-5258-ab85-933a3018e8a1
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F0c3b70e2f75f48df870ce226ec99923f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/0c3b70e2f75f48df870ce226ec99923f/images/large/1.jpg not downloaded yet
2026-03-24 18:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/742/d23962a1223442aeb9b5a3ae0961b180/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8c8110>
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335d649b-7a33-582f-b16b-21d6f5329660/335d649b-7a33-582f-b16b-21d6f5329660_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F730%252F559650b3705b48cbb32a222887cdd488%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/730/559650b3705b48cbb32a222887cdd488/images/large/1.jpg saved to cache
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 335d649b-7a33-582f-b16b-21d6f5329660
2026-03-24 18:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 335d649b-7a33-582f-b16b-21d6f5329660, skipping ID generation
2026-03-24 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335d649b-7a33-582f-b16b-21d6f5329660 with scrape type 1
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 335d649b-7a33-582f-b16b-21d6f5329660 sending to next pipeline
2026-03-24 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 335d649b-7a33-582f-b16b-21d6f5329660, identifier: 1981048
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee22ef90>
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e7eb45-93a0-5325-814f-74cd7da03a8a/95e7eb45-93a0-5325-814f-74cd7da03a8a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F136%252F0bece2e69a0943c4ab04a80b7153d2be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/136/0bece2e69a0943c4ab04a80b7153d2be/images/large/1.jpg saved to cache
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95e7eb45-93a0-5325-814f-74cd7da03a8a
2026-03-24 18:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95e7eb45-93a0-5325-814f-74cd7da03a8a, skipping ID generation
2026-03-24 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e7eb45-93a0-5325-814f-74cd7da03a8a with scrape type 1
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95e7eb45-93a0-5325-814f-74cd7da03a8a sending to next pipeline
2026-03-24 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 95e7eb45-93a0-5325-814f-74cd7da03a8a, identifier: 1981042
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e2250>
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ba1731-3528-5f32-b700-e342e7e0df5c/e1ba1731-3528-5f32-b700-e342e7e0df5c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F8bdec5d4fa454fb280ab85bf7a63bd69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/8bdec5d4fa454fb280ab85bf7a63bd69/images/large/1.jpg saved to cache
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1ba1731-3528-5f32-b700-e342e7e0df5c
2026-03-24 18:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1ba1731-3528-5f32-b700-e342e7e0df5c, skipping ID generation
2026-03-24 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ba1731-3528-5f32-b700-e342e7e0df5c with scrape type 1
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1ba1731-3528-5f32-b700-e342e7e0df5c sending to next pipeline
2026-03-24 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e1ba1731-3528-5f32-b700-e342e7e0df5c, identifier: 1981047
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e5350>
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f60e9c0f-10fc-5274-8c05-0a26a334eb91/f60e9c0f-10fc-5274-8c05-0a26a334eb91_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F479%252F8c5ad989323e4b4a9aa3bb4c7caa72f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/479/8c5ad989323e4b4a9aa3bb4c7caa72f6/images/large/1.jpg saved to cache
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f60e9c0f-10fc-5274-8c05-0a26a334eb91
2026-03-24 18:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f60e9c0f-10fc-5274-8c05-0a26a334eb91, skipping ID generation
2026-03-24 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f60e9c0f-10fc-5274-8c05-0a26a334eb91 with scrape type 1
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f60e9c0f-10fc-5274-8c05-0a26a334eb91 sending to next pipeline
2026-03-24 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f60e9c0f-10fc-5274-8c05-0a26a334eb91, identifier: 1981038
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb62810>
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701bb2de-d432-5b3d-83b3-82c266dabbd9/701bb2de-d432-5b3d-83b3-82c266dabbd9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F572%252Fd89eb6b6e2d349f7b9aef3b12d310f4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/572/d89eb6b6e2d349f7b9aef3b12d310f4c/images/large/1.jpg saved to cache
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 701bb2de-d432-5b3d-83b3-82c266dabbd9
2026-03-24 18:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 701bb2de-d432-5b3d-83b3-82c266dabbd9, skipping ID generation
2026-03-24 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701bb2de-d432-5b3d-83b3-82c266dabbd9 with scrape type 1
2026-03-24 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 701bb2de-d432-5b3d-83b3-82c266dabbd9 sending to next pipeline
2026-03-24 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 701bb2de-d432-5b3d-83b3-82c266dabbd9, identifier: 1981046
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e2790>
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c90d692-dde2-5890-b4e6-b4473169458d/8c90d692-dde2-5890-b4e6-b4473169458d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F526%252F1d6ea23f21af49e58c83631ebd74f1f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/526/1d6ea23f21af49e58c83631ebd74f1f4/images/large/1.jpg saved to cache
2026-03-24 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c90d692-dde2-5890-b4e6-b4473169458d
2026-03-24 18:30:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c90d692-dde2-5890-b4e6-b4473169458d, skipping ID generation
2026-03-24 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c90d692-dde2-5890-b4e6-b4473169458d with scrape type 1
2026-03-24 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c90d692-dde2-5890-b4e6-b4473169458d sending to next pipeline
2026-03-24 18:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8c90d692-dde2-5890-b4e6-b4473169458d, identifier: 1981039
2026-03-24 18:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/433/333a72161fe44d26b27a887e7c4e0076/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:43 [ayvens.es] INFO: Found listing with ID: 1981061
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981061%27 HTTP/1.1" 200 None
2026-03-24 18:30:43 [ayvens.es] INFO: Scrape type for 1981061: 1
2026-03-24 18:30:43 [ayvens.es] INFO: Extracting data for car ID: 1981061
2026-03-24 18:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd8563ab-a7f9-538f-9312-7520d989aa66 with identifier: 1981061
2026-03-24 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8563ab-a7f9-538f-9312-7520d989aa66 with scrape type 1
2026-03-24 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd8563ab-a7f9-538f-9312-7520d989aa66
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252F84482be666ce4cd3bff7b7550d340f5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/84482be666ce4cd3bff7b7550d340f5c/images/large/1.jpg not downloaded yet
2026-03-24 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1981048
2026-03-24 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1981048
2026-03-24 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1981048 to the API
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/730/559650b3705b48cbb32a222887cdd488/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Vivo rojo opaca',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '335d649b-7a33-582f-b16b-21d6f5329660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 201579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335d649b-7a33-582f-b16b-21d6f5329660/335d649b-7a33-582f-b16b-21d6f5329660_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/730/559650b3705b48cbb32a222887cdd488/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981048%27 HTTP/1.1" 200 None
2026-03-24 18:30:43 [ayvens.es] INFO: Saving data for 1981048: {'created_time': 1774377043.438113, 'last_price_update_time': 1774377043.438123, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981048') HTTP/1.1" 204 0
2026-03-24 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 95e7eb45-93a0-5325-814f-74cd7da03a8a with identifier: 1981042
2026-03-24 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 95e7eb45-93a0-5325-814f-74cd7da03a8a with identifier: 1981042
2026-03-24 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 95e7eb45-93a0-5325-814f-74cd7da03a8a with identifier: 1981042 to the API
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/136/0bece2e69a0943c4ab04a80b7153d2be/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '95e7eb45-93a0-5325-814f-74cd7da03a8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 99804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e7eb45-93a0-5325-814f-74cd7da03a8a/95e7eb45-93a0-5325-814f-74cd7da03a8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/136/0bece2e69a0943c4ab04a80b7153d2be/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon L1H1 Blue dCi 81 Kw (110 CV)',
 'transmission': 'manual',
 'trim': 'Furgon L1H1 Blue dCi 81 Kw (110 CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981042%27 HTTP/1.1" 200 None
2026-03-24 18:30:43 [ayvens.es] INFO: Saving data for 1981042: {'created_time': 1774377043.74387, 'last_price_update_time': 1774377043.74388, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981042') HTTP/1.1" 204 0
2026-03-24 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e1ba1731-3528-5f32-b700-e342e7e0df5c with identifier: 1981047
2026-03-24 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e1ba1731-3528-5f32-b700-e342e7e0df5c with identifier: 1981047
2026-03-24 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e1ba1731-3528-5f32-b700-e342e7e0df5c with identifier: 1981047 to the API
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/781/8bdec5d4fa454fb280ab85bf7a63bd69/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e1ba1731-3528-5f32-b700-e342e7e0df5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 67894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ba1731-3528-5f32-b700-e342e7e0df5c/e1ba1731-3528-5f32-b700-e342e7e0df5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/781/8bdec5d4fa454fb280ab85bf7a63bd69/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Standard 600kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Pro Standard 600kg BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981047%27 HTTP/1.1" 200 None
2026-03-24 18:30:44 [ayvens.es] INFO: Saving data for 1981047: {'created_time': 1774377044.035305, 'last_price_update_time': 1774377044.035314, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981047') HTTP/1.1" 204 0
2026-03-24 18:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1981038
2026-03-24 18:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1981038
2026-03-24 18:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1981038 to the API
2026-03-24 18:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/479/8c5ad989323e4b4a9aa3bb4c7caa72f6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f60e9c0f-10fc-5274-8c05-0a26a334eb91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 134357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f60e9c0f-10fc-5274-8c05-0a26a334eb91/f60e9c0f-10fc-5274-8c05-0a26a334eb91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/479/8c5ad989323e4b4a9aa3bb4c7caa72f6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2017}
2026-03-24 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981038%27 HTTP/1.1" 200 None
2026-03-24 18:30:45 [ayvens.es] INFO: Saving data for 1981038: {'created_time': 1774377045.821612, 'last_price_update_time': 1774377045.821622, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981038') HTTP/1.1" 204 0
2026-03-24 18:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 701bb2de-d432-5b3d-83b3-82c266dabbd9 with identifier: 1981046
2026-03-24 18:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 701bb2de-d432-5b3d-83b3-82c266dabbd9 with identifier: 1981046
2026-03-24 18:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 701bb2de-d432-5b3d-83b3-82c266dabbd9 with identifier: 1981046 to the API
2026-03-24 18:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/572/d89eb6b6e2d349f7b9aef3b12d310f4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '701bb2de-d432-5b3d-83b3-82c266dabbd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 36117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701bb2de-d432-5b3d-83b3-82c266dabbd9/701bb2de-d432-5b3d-83b3-82c266dabbd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/572/d89eb6b6e2d349f7b9aef3b12d310f4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981046%27 HTTP/1.1" 200 None
2026-03-24 18:30:46 [ayvens.es] INFO: Saving data for 1981046: {'created_time': 1774377046.118275, 'last_price_update_time': 1774377046.118285, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981046') HTTP/1.1" 204 0
2026-03-24 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8c90d692-dde2-5890-b4e6-b4473169458d with identifier: 1981039
2026-03-24 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8c90d692-dde2-5890-b4e6-b4473169458d with identifier: 1981039
2026-03-24 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8c90d692-dde2-5890-b4e6-b4473169458d with identifier: 1981039 to the API
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/526/1d6ea23f21af49e58c83631ebd74f1f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco banquise s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c90d692-dde2-5890-b4e6-b4473169458d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 65019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c90d692-dde2-5890-b4e6-b4473169458d/8c90d692-dde2-5890-b4e6-b4473169458d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/526/1d6ea23f21af49e58c83631ebd74f1f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S LIVE PACK BUSINE',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S LIVE PACK BUSINE',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981039%27 HTTP/1.1" 200 None
2026-03-24 18:30:46 [ayvens.es] INFO: Saving data for 1981039: {'created_time': 1774377046.487436, 'last_price_update_time': 1774377046.487447, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981039') HTTP/1.1" 204 0
2026-03-24 18:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/618/0d08dd1bed224db48a92af4c330014ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/372/ad18a195e1d64aa48cf0f762e30df1e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/a4a9aebc86394bd6941e8c16b67563d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:46 [ayvens.es] INFO: Found listing with ID: 1981062
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981062%27 HTTP/1.1" 200 None
2026-03-24 18:30:46 [ayvens.es] INFO: Scrape type for 1981062: 1
2026-03-24 18:30:46 [ayvens.es] INFO: Extracting data for car ID: 1981062
2026-03-24 18:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1981062
2026-03-24 18:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65ac201-ca32-55ff-9b5e-a00bdf901033 with scrape type 1
2026-03-24 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e65ac201-ca32-55ff-9b5e-a00bdf901033
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F315%252F4e965399f1334fbb80695ae0ef7e63b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/315/4e965399f1334fbb80695ae0ef7e63b4/images/large/1.jpg not downloaded yet
2026-03-24 18:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6d4190>
2026-03-24 18:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ede593f-cf24-5905-83c9-f800bb7fa168/8ede593f-cf24-5905-83c9-f800bb7fa168_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F742%252Fd23962a1223442aeb9b5a3ae0961b180%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/742/d23962a1223442aeb9b5a3ae0961b180/images/large/1.jpg saved to cache
2026-03-24 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ede593f-cf24-5905-83c9-f800bb7fa168
2026-03-24 18:30:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ede593f-cf24-5905-83c9-f800bb7fa168, skipping ID generation
2026-03-24 18:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ede593f-cf24-5905-83c9-f800bb7fa168 with scrape type 1
2026-03-24 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ede593f-cf24-5905-83c9-f800bb7fa168 sending to next pipeline
2026-03-24 18:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ede593f-cf24-5905-83c9-f800bb7fa168, identifier: 1981049
2026-03-24 18:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/133/8736de6463bc4aa9a383877b797f838b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ede593f-cf24-5905-83c9-f800bb7fa168 with identifier: 1981049
2026-03-24 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ede593f-cf24-5905-83c9-f800bb7fa168 with identifier: 1981049
2026-03-24 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ede593f-cf24-5905-83c9-f800bb7fa168 with identifier: 1981049 to the API
2026-03-24 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/742/d23962a1223442aeb9b5a3ae0961b180/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanc banquise s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ede593f-cf24-5905-83c9-f800bb7fa168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 81487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ede593f-cf24-5905-83c9-f800bb7fa168/8ede593f-cf24-5905-83c9-f800bb7fa168_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/742/d23962a1223442aeb9b5a3ae0961b180/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981049%27 HTTP/1.1" 200 None
2026-03-24 18:30:47 [ayvens.es] INFO: Saving data for 1981049: {'created_time': 1774377047.231997, 'last_price_update_time': 1774377047.23201, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981049') HTTP/1.1" 204 0
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7d55d0>
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_351e9346-81dd-59bc-a3cd-d5a037d88c8c/351e9346-81dd-59bc-a3cd-d5a037d88c8c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F433%252F333a72161fe44d26b27a887e7c4e0076%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/433/333a72161fe44d26b27a887e7c4e0076/images/large/1.jpg saved to cache
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 351e9346-81dd-59bc-a3cd-d5a037d88c8c
2026-03-24 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 351e9346-81dd-59bc-a3cd-d5a037d88c8c, skipping ID generation
2026-03-24 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351e9346-81dd-59bc-a3cd-d5a037d88c8c with scrape type 1
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 351e9346-81dd-59bc-a3cd-d5a037d88c8c sending to next pipeline
2026-03-24 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 351e9346-81dd-59bc-a3cd-d5a037d88c8c, identifier: 1981051
2026-03-24 18:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/662/a76248b132cf44dfaa059ff83ae90c68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:47 [ayvens.es] INFO: Found listing with ID: 1981063
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981063%27 HTTP/1.1" 200 None
2026-03-24 18:30:47 [ayvens.es] INFO: Scrape type for 1981063: 1
2026-03-24 18:30:47 [ayvens.es] INFO: Extracting data for car ID: 1981063
2026-03-24 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1981063
2026-03-24 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d584d-074d-594d-9be9-32af1cffcb34 with scrape type 1
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef5d584d-074d-594d-9be9-32af1cffcb34
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252F58c73fe7897541c88b8f248a5f428737%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/58c73fe7897541c88b8f248a5f428737/images/large/1.jpg not downloaded yet
2026-03-24 18:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 351e9346-81dd-59bc-a3cd-d5a037d88c8c with identifier: 1981051
2026-03-24 18:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 351e9346-81dd-59bc-a3cd-d5a037d88c8c with identifier: 1981051
2026-03-24 18:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 351e9346-81dd-59bc-a3cd-d5a037d88c8c with identifier: 1981051 to the API
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/433/333a72161fe44d26b27a887e7c4e0076/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '351e9346-81dd-59bc-a3cd-d5a037d88c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 166908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_351e9346-81dd-59bc-a3cd-d5a037d88c8c/351e9346-81dd-59bc-a3cd-d5a037d88c8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/433/333a72161fe44d26b27a887e7c4e0076/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981051%27 HTTP/1.1" 200 None
2026-03-24 18:30:47 [ayvens.es] INFO: Saving data for 1981051: {'created_time': 1774377047.758431, 'last_price_update_time': 1774377047.758441, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981051') HTTP/1.1" 204 0
2026-03-24 18:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/527/ffad9308a0bf4618b6d4ae231c327f52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9b1d50>
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526/cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F618%252F0d08dd1bed224db48a92af4c330014ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/618/0d08dd1bed224db48a92af4c330014ea/images/large/1.jpg saved to cache
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526
2026-03-24 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526, skipping ID generation
2026-03-24 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526 with scrape type 1
2026-03-24 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526 sending to next pipeline
2026-03-24 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526, identifier: 1981050
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb93150>
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3aa3f072-9ae5-5928-943c-f48af6d4577a/3aa3f072-9ae5-5928-943c-f48af6d4577a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252Fad18a195e1d64aa48cf0f762e30df1e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/ad18a195e1d64aa48cf0f762e30df1e0/images/large/1.jpg saved to cache
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3aa3f072-9ae5-5928-943c-f48af6d4577a
2026-03-24 18:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3aa3f072-9ae5-5928-943c-f48af6d4577a, skipping ID generation
2026-03-24 18:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa3f072-9ae5-5928-943c-f48af6d4577a with scrape type 1
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3aa3f072-9ae5-5928-943c-f48af6d4577a sending to next pipeline
2026-03-24 18:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3aa3f072-9ae5-5928-943c-f48af6d4577a, identifier: 1981054
2026-03-24 18:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a36d0>
2026-03-24 18:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca72a149-8115-5b78-bcae-a29c0c3e0ab7/ca72a149-8115-5b78-bcae-a29c0c3e0ab7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252Fa4a9aebc86394bd6941e8c16b67563d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/a4a9aebc86394bd6941e8c16b67563d2/images/large/1.jpg saved to cache
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7
2026-03-24 18:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca72a149-8115-5b78-bcae-a29c0c3e0ab7, skipping ID generation
2026-03-24 18:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with scrape type 1
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7 sending to next pipeline
2026-03-24 18:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca72a149-8115-5b78-bcae-a29c0c3e0ab7, identifier: 1981055
2026-03-24 18:30:48 [ayvens.es] INFO: Found listing with ID: 1981064
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981064%27 HTTP/1.1" 200 None
2026-03-24 18:30:48 [ayvens.es] INFO: Scrape type for 1981064: 1
2026-03-24 18:30:48 [ayvens.es] INFO: Extracting data for car ID: 1981064
2026-03-24 18:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9efea71-1693-52fb-9743-17191af4395e with identifier: 1981064
2026-03-24 18:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9efea71-1693-52fb-9743-17191af4395e with scrape type 1
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9efea71-1693-52fb-9743-17191af4395e
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F696%252F86bf7ab85b11407b80278d48bc366761%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/696/86bf7ab85b11407b80278d48bc366761/images/large/1.jpg not downloaded yet
2026-03-24 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526 with identifier: 1981050
2026-03-24 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526 with identifier: 1981050
2026-03-24 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526 with identifier: 1981050 to the API
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/618/0d08dd1bed224db48a92af4c330014ea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco banquise s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 54673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526/cb0c33b0-91ca-5f8d-afa4-d3dbd08ed526_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/618/0d08dd1bed224db48a92af4c330014ea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981050%27 HTTP/1.1" 200 None
2026-03-24 18:30:48 [ayvens.es] INFO: Saving data for 1981050: {'created_time': 1774377048.536745, 'last_price_update_time': 1774377048.536754, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981050') HTTP/1.1" 204 0
2026-03-24 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3aa3f072-9ae5-5928-943c-f48af6d4577a with identifier: 1981054
2026-03-24 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3aa3f072-9ae5-5928-943c-f48af6d4577a with identifier: 1981054
2026-03-24 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3aa3f072-9ae5-5928-943c-f48af6d4577a with identifier: 1981054 to the API
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/372/ad18a195e1d64aa48cf0f762e30df1e0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3aa3f072-9ae5-5928-943c-f48af6d4577a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 166849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa3f072-9ae5-5928-943c-f48af6d4577a/3aa3f072-9ae5-5928-943c-f48af6d4577a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/ad18a195e1d64aa48cf0f762e30df1e0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2017}
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981054%27 HTTP/1.1" 200 None
2026-03-24 18:30:48 [ayvens.es] INFO: Saving data for 1981054: {'created_time': 1774377048.912926, 'last_price_update_time': 1774377048.912935, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981054') HTTP/1.1" 204 0
2026-03-24 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1981055
2026-03-24 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1981055
2026-03-24 18:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1981055 to the API
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/034/a4a9aebc86394bd6941e8c16b67563d2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ca72a149-8115-5b78-bcae-a29c0c3e0ab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 25438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca72a149-8115-5b78-bcae-a29c0c3e0ab7/ca72a149-8115-5b78-bcae-a29c0c3e0ab7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/a4a9aebc86394bd6941e8c16b67563d2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981055%27 HTTP/1.1" 200 None
2026-03-24 18:30:49 [ayvens.es] INFO: Saving data for 1981055: {'created_time': 1774377049.240899, 'last_price_update_time': 1774377049.240911, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981055') HTTP/1.1" 204 0
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7c5410>
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab06b5df-22a6-501a-bb3f-83990d1d6957/ab06b5df-22a6-501a-bb3f-83990d1d6957_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F133%252F8736de6463bc4aa9a383877b797f838b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/133/8736de6463bc4aa9a383877b797f838b/images/large/1.jpg saved to cache
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab06b5df-22a6-501a-bb3f-83990d1d6957
2026-03-24 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab06b5df-22a6-501a-bb3f-83990d1d6957, skipping ID generation
2026-03-24 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab06b5df-22a6-501a-bb3f-83990d1d6957 with scrape type 1
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab06b5df-22a6-501a-bb3f-83990d1d6957 sending to next pipeline
2026-03-24 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab06b5df-22a6-501a-bb3f-83990d1d6957, identifier: 1981053
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb70bd0>
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d7a975-3e6b-53f0-be44-2ca8eb474607/88d7a975-3e6b-53f0-be44-2ca8eb474607_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F662%252Fa76248b132cf44dfaa059ff83ae90c68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/662/a76248b132cf44dfaa059ff83ae90c68/images/large/1.jpg saved to cache
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88d7a975-3e6b-53f0-be44-2ca8eb474607
2026-03-24 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88d7a975-3e6b-53f0-be44-2ca8eb474607, skipping ID generation
2026-03-24 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d7a975-3e6b-53f0-be44-2ca8eb474607 with scrape type 1
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88d7a975-3e6b-53f0-be44-2ca8eb474607 sending to next pipeline
2026-03-24 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88d7a975-3e6b-53f0-be44-2ca8eb474607, identifier: 1981052
2026-03-24 18:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/128/37a30ac92c4544d093fcf48fb1a857d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/059/e4ab9abb4c90484ab242daa732f3c524/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/278/ab4416e958504aabbcc4832566142127/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:49 [ayvens.es] INFO: Found listing with ID: 1981065
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981065%27 HTTP/1.1" 200 None
2026-03-24 18:30:49 [ayvens.es] INFO: Scrape type for 1981065: 1
2026-03-24 18:30:49 [ayvens.es] INFO: Extracting data for car ID: 1981065
2026-03-24 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13833c31-f406-53d9-9239-0ac3c5b01458 with identifier: 1981065
2026-03-24 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13833c31-f406-53d9-9239-0ac3c5b01458 with scrape type 1
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13833c31-f406-53d9-9239-0ac3c5b01458
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F184%252Fc9edb198786b46a8b35c7946a238132a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/184/c9edb198786b46a8b35c7946a238132a/images/large/1.jpg not downloaded yet
2026-03-24 18:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1981053
2026-03-24 18:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1981053
2026-03-24 18:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1981053 to the API
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/133/8736de6463bc4aa9a383877b797f838b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Verde vaillant group',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab06b5df-22a6-501a-bb3f-83990d1d6957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 106461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab06b5df-22a6-501a-bb3f-83990d1d6957/ab06b5df-22a6-501a-bb3f-83990d1d6957_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/133/8736de6463bc4aa9a383877b797f838b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981053%27 HTTP/1.1" 200 None
2026-03-24 18:30:49 [ayvens.es] INFO: Saving data for 1981053: {'created_time': 1774377049.942461, 'last_price_update_time': 1774377049.942471, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981053') HTTP/1.1" 204 0
2026-03-24 18:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88d7a975-3e6b-53f0-be44-2ca8eb474607 with identifier: 1981052
2026-03-24 18:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88d7a975-3e6b-53f0-be44-2ca8eb474607 with identifier: 1981052
2026-03-24 18:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88d7a975-3e6b-53f0-be44-2ca8eb474607 with identifier: 1981052 to the API
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/662/a76248b132cf44dfaa059ff83ae90c68/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '88d7a975-3e6b-53f0-be44-2ca8eb474607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 149428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d7a975-3e6b-53f0-be44-2ca8eb474607/88d7a975-3e6b-53f0-be44-2ca8eb474607_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/662/a76248b132cf44dfaa059ff83ae90c68/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981052%27 HTTP/1.1" 200 None
2026-03-24 18:30:50 [ayvens.es] INFO: Saving data for 1981052: {'created_time': 1774377050.229716, 'last_price_update_time': 1774377050.229726, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981052') HTTP/1.1" 204 0
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eec18a50>
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78860afc-54ee-5779-ba9f-582d6ca4dace/78860afc-54ee-5779-ba9f-582d6ca4dace_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252Fffad9308a0bf4618b6d4ae231c327f52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/ffad9308a0bf4618b6d4ae231c327f52/images/large/1.jpg saved to cache
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78860afc-54ee-5779-ba9f-582d6ca4dace
2026-03-24 18:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78860afc-54ee-5779-ba9f-582d6ca4dace, skipping ID generation
2026-03-24 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78860afc-54ee-5779-ba9f-582d6ca4dace with scrape type 1
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78860afc-54ee-5779-ba9f-582d6ca4dace sending to next pipeline
2026-03-24 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 78860afc-54ee-5779-ba9f-582d6ca4dace, identifier: 1981056
2026-03-24 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1981056
2026-03-24 18:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1981056
2026-03-24 18:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1981056 to the API
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/527/ffad9308a0bf4618b6d4ae231c327f52/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '78860afc-54ee-5779-ba9f-582d6ca4dace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 152768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78860afc-54ee-5779-ba9f-582d6ca4dace/78860afc-54ee-5779-ba9f-582d6ca4dace_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/527/ffad9308a0bf4618b6d4ae231c327f52/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD S/S 75kW (100CV) Express L H1 650',
 'transmission': 'manual',
 'trim': '1.5 TD S/S 75kW (100CV) Express L H1 650',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981056%27 HTTP/1.1" 200 None
2026-03-24 18:30:50 [ayvens.es] INFO: Saving data for 1981056: {'created_time': 1774377050.709655, 'last_price_update_time': 1774377050.709667, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981056') HTTP/1.1" 204 0
2026-03-24 18:30:50 [ayvens.es] INFO: Found listing with ID: 1981066
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981066%27 HTTP/1.1" 200 None
2026-03-24 18:30:50 [ayvens.es] INFO: Scrape type for 1981066: 1
2026-03-24 18:30:50 [ayvens.es] INFO: Extracting data for car ID: 1981066
2026-03-24 18:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed with identifier: 1981066
2026-03-24 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed with scrape type 1
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F392e22f8d11d494c833d67b9dca750d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/392e22f8d11d494c833d67b9dca750d6/images/large/1.jpg not downloaded yet
2026-03-24 18:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/602/0c3b70e2f75f48df870ce226ec99923f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/561/84482be666ce4cd3bff7b7550d340f5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f1430790>
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a54a8af-6854-5b4f-b1f5-1a96c165f867/4a54a8af-6854-5b4f-b1f5-1a96c165f867_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F37a30ac92c4544d093fcf48fb1a857d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/37a30ac92c4544d093fcf48fb1a857d9/images/large/1.jpg saved to cache
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867
2026-03-24 18:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a54a8af-6854-5b4f-b1f5-1a96c165f867, skipping ID generation
2026-03-24 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with scrape type 1
2026-03-24 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867 sending to next pipeline
2026-03-24 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4a54a8af-6854-5b4f-b1f5-1a96c165f867, identifier: 1981057
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6cfd50>
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49d1e343-de0f-5488-929a-8ffb7f7e6389/49d1e343-de0f-5488-929a-8ffb7f7e6389_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F059%252Fe4ab9abb4c90484ab242daa732f3c524%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/059/e4ab9abb4c90484ab242daa732f3c524/images/large/1.jpg saved to cache
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49d1e343-de0f-5488-929a-8ffb7f7e6389
2026-03-24 18:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49d1e343-de0f-5488-929a-8ffb7f7e6389, skipping ID generation
2026-03-24 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49d1e343-de0f-5488-929a-8ffb7f7e6389 with scrape type 1
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49d1e343-de0f-5488-929a-8ffb7f7e6389 sending to next pipeline
2026-03-24 18:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49d1e343-de0f-5488-929a-8ffb7f7e6389, identifier: 1981058
2026-03-24 18:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea72950>
2026-03-24 18:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e25c1f-90d7-5b32-8441-e53caa748122/d3e25c1f-90d7-5b32-8441-e53caa748122_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F278%252Fab4416e958504aabbcc4832566142127%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/278/ab4416e958504aabbcc4832566142127/images/large/1.jpg saved to cache
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3e25c1f-90d7-5b32-8441-e53caa748122
2026-03-24 18:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3e25c1f-90d7-5b32-8441-e53caa748122, skipping ID generation
2026-03-24 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e25c1f-90d7-5b32-8441-e53caa748122 with scrape type 1
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3e25c1f-90d7-5b32-8441-e53caa748122 sending to next pipeline
2026-03-24 18:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3e25c1f-90d7-5b32-8441-e53caa748122, identifier: 1981059
2026-03-24 18:30:51 [ayvens.es] INFO: Found listing with ID: 1981067
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981067%27 HTTP/1.1" 200 None
2026-03-24 18:30:51 [ayvens.es] INFO: Scrape type for 1981067: 1
2026-03-24 18:30:51 [ayvens.es] INFO: Extracting data for car ID: 1981067
2026-03-24 18:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1981067
2026-03-24 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93588b6b-f9c7-5fb2-b00d-341665c84f13 with scrape type 1
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 93588b6b-f9c7-5fb2-b00d-341665c84f13
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F8ad12f73692c4ba79e5a0a326213bd15%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/8ad12f73692c4ba79e5a0a326213bd15/images/large/1.jpg not downloaded yet
2026-03-24 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1981057
2026-03-24 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1981057
2026-03-24 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1981057 to the API
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/128/37a30ac92c4544d093fcf48fb1a857d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco opaca',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4a54a8af-6854-5b4f-b1f5-1a96c165f867',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 140446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a54a8af-6854-5b4f-b1f5-1a96c165f867/4a54a8af-6854-5b4f-b1f5-1a96c165f867_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/128/37a30ac92c4544d093fcf48fb1a857d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981057%27 HTTP/1.1" 200 None
2026-03-24 18:30:51 [ayvens.es] INFO: Saving data for 1981057: {'created_time': 1774377051.577762, 'last_price_update_time': 1774377051.577772, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981057') HTTP/1.1" 204 0
2026-03-24 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1981058
2026-03-24 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1981058
2026-03-24 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1981058 to the API
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/059/e4ab9abb4c90484ab242daa732f3c524/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '49d1e343-de0f-5488-929a-8ffb7f7e6389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 135516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49d1e343-de0f-5488-929a-8ffb7f7e6389/49d1e343-de0f-5488-929a-8ffb7f7e6389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/059/e4ab9abb4c90484ab242daa732f3c524/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base N1 1.3 MJet 55kW (75CV) E5+',
 'transmission': 'manual',
 'trim': 'Cargo Base N1 1.3 MJet 55kW (75CV) E5+',
 'vin': None,
 'year': 2017}
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981058%27 HTTP/1.1" 200 None
2026-03-24 18:30:51 [ayvens.es] INFO: Saving data for 1981058: {'created_time': 1774377051.889365, 'last_price_update_time': 1774377051.889374, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981058') HTTP/1.1" 204 0
2026-03-24 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3e25c1f-90d7-5b32-8441-e53caa748122 with identifier: 1981059
2026-03-24 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3e25c1f-90d7-5b32-8441-e53caa748122 with identifier: 1981059
2026-03-24 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3e25c1f-90d7-5b32-8441-e53caa748122 with identifier: 1981059 to the API
2026-03-24 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/278/ab4416e958504aabbcc4832566142127/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3e25c1f-90d7-5b32-8441-e53caa748122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 147808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e25c1f-90d7-5b32-8441-e53caa748122/d3e25c1f-90d7-5b32-8441-e53caa748122_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/278/ab4416e958504aabbcc4832566142127/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981059%27 HTTP/1.1" 200 None
2026-03-24 18:30:52 [ayvens.es] INFO: Saving data for 1981059: {'created_time': 1774377052.256233, 'last_price_update_time': 1774377052.256246, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981059') HTTP/1.1" 204 0
2026-03-24 18:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/315/4e965399f1334fbb80695ae0ef7e63b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:52 [ayvens.es] INFO: Found listing with ID: 1981068
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981068%27 HTTP/1.1" 200 None
2026-03-24 18:30:52 [ayvens.es] INFO: Scrape type for 1981068: 1
2026-03-24 18:30:52 [ayvens.es] INFO: Extracting data for car ID: 1981068
2026-03-24 18:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1981068
2026-03-24 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d0ba2e-f412-58da-af00-47fda2c264ef with scrape type 1
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 86d0ba2e-f412-58da-af00-47fda2c264ef
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F3c91457a969d4e86888eba8dfc458a83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/3c91457a969d4e86888eba8dfc458a83/images/large/1.jpg not downloaded yet
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef5e090>
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f3fce2-0a28-5258-ab85-933a3018e8a1/62f3fce2-0a28-5258-ab85-933a3018e8a1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F0c3b70e2f75f48df870ce226ec99923f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/0c3b70e2f75f48df870ce226ec99923f/images/large/1.jpg saved to cache
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62f3fce2-0a28-5258-ab85-933a3018e8a1
2026-03-24 18:30:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62f3fce2-0a28-5258-ab85-933a3018e8a1, skipping ID generation
2026-03-24 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f3fce2-0a28-5258-ab85-933a3018e8a1 with scrape type 1
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62f3fce2-0a28-5258-ab85-933a3018e8a1 sending to next pipeline
2026-03-24 18:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62f3fce2-0a28-5258-ab85-933a3018e8a1, identifier: 1981060
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea959d0>
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8563ab-a7f9-538f-9312-7520d989aa66/fd8563ab-a7f9-538f-9312-7520d989aa66_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252F84482be666ce4cd3bff7b7550d340f5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/84482be666ce4cd3bff7b7550d340f5c/images/large/1.jpg saved to cache
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd8563ab-a7f9-538f-9312-7520d989aa66
2026-03-24 18:30:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd8563ab-a7f9-538f-9312-7520d989aa66, skipping ID generation
2026-03-24 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8563ab-a7f9-538f-9312-7520d989aa66 with scrape type 1
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd8563ab-a7f9-538f-9312-7520d989aa66 sending to next pipeline
2026-03-24 18:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd8563ab-a7f9-538f-9312-7520d989aa66, identifier: 1981061
2026-03-24 18:30:52 [ayvens.es] INFO: Found listing with ID: 1981069
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981069%27 HTTP/1.1" 200 None
2026-03-24 18:30:52 [ayvens.es] INFO: Scrape type for 1981069: 1
2026-03-24 18:30:52 [ayvens.es] INFO: Extracting data for car ID: 1981069
2026-03-24 18:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1981069
2026-03-24 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add41c3a-84e0-5deb-b366-32c332cf7eb3 with scrape type 1
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item add41c3a-84e0-5deb-b366-32c332cf7eb3
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F146%252Fbb56f187cb99435d97a961390bb6502c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/146/bb56f187cb99435d97a961390bb6502c/images/large/1.jpg not downloaded yet
2026-03-24 18:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1981060
2026-03-24 18:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1981060
2026-03-24 18:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1981060 to the API
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/602/0c3b70e2f75f48df870ce226ec99923f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '62f3fce2-0a28-5258-ab85-933a3018e8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 143335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f3fce2-0a28-5258-ab85-933a3018e8a1/62f3fce2-0a28-5258-ab85-933a3018e8a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/0c3b70e2f75f48df870ce226ec99923f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981060%27 HTTP/1.1" 200 None
2026-03-24 18:30:53 [ayvens.es] INFO: Saving data for 1981060: {'created_time': 1774377053.080446, 'last_price_update_time': 1774377053.08046, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981060') HTTP/1.1" 204 0
2026-03-24 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd8563ab-a7f9-538f-9312-7520d989aa66 with identifier: 1981061
2026-03-24 18:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd8563ab-a7f9-538f-9312-7520d989aa66 with identifier: 1981061
2026-03-24 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd8563ab-a7f9-538f-9312-7520d989aa66 with identifier: 1981061 to the API
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/561/84482be666ce4cd3bff7b7550d340f5c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fd8563ab-a7f9-538f-9312-7520d989aa66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 84258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8563ab-a7f9-538f-9312-7520d989aa66/fd8563ab-a7f9-538f-9312-7520d989aa66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/561/84482be666ce4cd3bff7b7550d340f5c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981061%27 HTTP/1.1" 200 None
2026-03-24 18:30:53 [ayvens.es] INFO: Saving data for 1981061: {'created_time': 1774377053.52933, 'last_price_update_time': 1774377053.52934, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981061') HTTP/1.1" 204 0
2026-03-24 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/857/58c73fe7897541c88b8f248a5f428737/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:53 [ayvens.es] INFO: Found listing with ID: 1981070
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981070%27 HTTP/1.1" 200 None
2026-03-24 18:30:53 [ayvens.es] INFO: Scrape type for 1981070: 1
2026-03-24 18:30:53 [ayvens.es] INFO: Extracting data for car ID: 1981070
2026-03-24 18:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a97ab4-6ede-5e42-b8c3-cb703c95c2af with identifier: 1981070
2026-03-24 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a97ab4-6ede-5e42-b8c3-cb703c95c2af with scrape type 1
2026-03-24 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3a97ab4-6ede-5e42-b8c3-cb703c95c2af
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F528%252F5eaf45d596e043df8c73498109c869fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/528/5eaf45d596e043df8c73498109c869fa/images/large/1.jpg not downloaded yet
2026-03-24 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/184/c9edb198786b46a8b35c7946a238132a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeafc890>
2026-03-24 18:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e65ac201-ca32-55ff-9b5e-a00bdf901033/e65ac201-ca32-55ff-9b5e-a00bdf901033_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F315%252F4e965399f1334fbb80695ae0ef7e63b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/315/4e965399f1334fbb80695ae0ef7e63b4/images/large/1.jpg saved to cache
2026-03-24 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e65ac201-ca32-55ff-9b5e-a00bdf901033
2026-03-24 18:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e65ac201-ca32-55ff-9b5e-a00bdf901033, skipping ID generation
2026-03-24 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65ac201-ca32-55ff-9b5e-a00bdf901033 with scrape type 1
2026-03-24 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e65ac201-ca32-55ff-9b5e-a00bdf901033 sending to next pipeline
2026-03-24 18:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e65ac201-ca32-55ff-9b5e-a00bdf901033, identifier: 1981062
2026-03-24 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/696/86bf7ab85b11407b80278d48bc366761/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:53 [ayvens.es] INFO: Found listing with ID: 1981071
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981071%27 HTTP/1.1" 200 None
2026-03-24 18:30:53 [ayvens.es] INFO: Scrape type for 1981071: 1
2026-03-24 18:30:53 [ayvens.es] INFO: Extracting data for car ID: 1981071
2026-03-24 18:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ae69a0-b711-5f13-a758-ded18bc086bb with identifier: 1981071
2026-03-24 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ae69a0-b711-5f13-a758-ded18bc086bb with scrape type 1
2026-03-24 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f7ae69a0-b711-5f13-a758-ded18bc086bb
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F821%252Fa9481a0610e445959358fd8e32c0f619%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/821/a9481a0610e445959358fd8e32c0f619/images/large/1.jpg not downloaded yet
2026-03-24 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1981062
2026-03-24 18:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1981062
2026-03-24 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1981062 to the API
2026-03-24 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/315/4e965399f1334fbb80695ae0ef7e63b4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e65ac201-ca32-55ff-9b5e-a00bdf901033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 128686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e65ac201-ca32-55ff-9b5e-a00bdf901033/e65ac201-ca32-55ff-9b5e-a00bdf901033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/315/4e965399f1334fbb80695ae0ef7e63b4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo Base 1.3 Multijet 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Multijet 70kW (95CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981062%27 HTTP/1.1" 200 None
2026-03-24 18:30:54 [ayvens.es] INFO: Saving data for 1981062: {'created_time': 1774377054.136659, 'last_price_update_time': 1774377054.136669, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981062') HTTP/1.1" 204 0
2026-03-24 18:30:54 [ayvens.es] INFO: Found listing with ID: 1981072
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981072%27 HTTP/1.1" 200 None
2026-03-24 18:30:54 [ayvens.es] INFO: Scrape type for 1981072: 1
2026-03-24 18:30:54 [ayvens.es] INFO: Extracting data for car ID: 1981072
2026-03-24 18:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc862372-0044-50dc-ba18-63ffd1951670 with identifier: 1981072
2026-03-24 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc862372-0044-50dc-ba18-63ffd1951670 with scrape type 1
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc862372-0044-50dc-ba18-63ffd1951670
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F431%252F5401872513c748cf80e37657df6136b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/431/5401872513c748cf80e37657df6136b3/images/large/1.jpg not downloaded yet
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7fd750>
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d584d-074d-594d-9be9-32af1cffcb34/ef5d584d-074d-594d-9be9-32af1cffcb34_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252F58c73fe7897541c88b8f248a5f428737%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/58c73fe7897541c88b8f248a5f428737/images/large/1.jpg saved to cache
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef5d584d-074d-594d-9be9-32af1cffcb34
2026-03-24 18:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef5d584d-074d-594d-9be9-32af1cffcb34, skipping ID generation
2026-03-24 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d584d-074d-594d-9be9-32af1cffcb34 with scrape type 1
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef5d584d-074d-594d-9be9-32af1cffcb34 sending to next pipeline
2026-03-24 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef5d584d-074d-594d-9be9-32af1cffcb34, identifier: 1981063
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f09f0290>
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13833c31-f406-53d9-9239-0ac3c5b01458/13833c31-f406-53d9-9239-0ac3c5b01458_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F184%252Fc9edb198786b46a8b35c7946a238132a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/184/c9edb198786b46a8b35c7946a238132a/images/large/1.jpg saved to cache
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13833c31-f406-53d9-9239-0ac3c5b01458
2026-03-24 18:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13833c31-f406-53d9-9239-0ac3c5b01458, skipping ID generation
2026-03-24 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13833c31-f406-53d9-9239-0ac3c5b01458 with scrape type 1
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13833c31-f406-53d9-9239-0ac3c5b01458 sending to next pipeline
2026-03-24 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13833c31-f406-53d9-9239-0ac3c5b01458, identifier: 1981065
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee23d950>
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9efea71-1693-52fb-9743-17191af4395e/f9efea71-1693-52fb-9743-17191af4395e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F696%252F86bf7ab85b11407b80278d48bc366761%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/696/86bf7ab85b11407b80278d48bc366761/images/large/1.jpg saved to cache
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9efea71-1693-52fb-9743-17191af4395e
2026-03-24 18:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9efea71-1693-52fb-9743-17191af4395e, skipping ID generation
2026-03-24 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9efea71-1693-52fb-9743-17191af4395e with scrape type 1
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9efea71-1693-52fb-9743-17191af4395e sending to next pipeline
2026-03-24 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f9efea71-1693-52fb-9743-17191af4395e, identifier: 1981064
2026-03-24 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/384/392e22f8d11d494c833d67b9dca750d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:54 [ayvens.es] INFO: Found listing with ID: 1981073
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981073%27 HTTP/1.1" 200 None
2026-03-24 18:30:54 [ayvens.es] INFO: Scrape type for 1981073: 1
2026-03-24 18:30:54 [ayvens.es] INFO: Extracting data for car ID: 1981073
2026-03-24 18:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1981073
2026-03-24 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with scrape type 1
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F168%252F3254c8f36298453a861bfed7652ac514%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/168/3254c8f36298453a861bfed7652ac514/images/large/1.jpg not downloaded yet
2026-03-24 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1981063
2026-03-24 18:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1981063
2026-03-24 18:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1981063 to the API
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/857/58c73fe7897541c88b8f248a5f428737/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef5d584d-074d-594d-9be9-32af1cffcb34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 148620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d584d-074d-594d-9be9-32af1cffcb34/ef5d584d-074d-594d-9be9-32af1cffcb34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/857/58c73fe7897541c88b8f248a5f428737/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'vin': None,
 'year': 2017}
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981063%27 HTTP/1.1" 200 None
2026-03-24 18:30:55 [ayvens.es] INFO: Saving data for 1981063: {'created_time': 1774377055.06208, 'last_price_update_time': 1774377055.06209, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981063') HTTP/1.1" 204 0
2026-03-24 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13833c31-f406-53d9-9239-0ac3c5b01458 with identifier: 1981065
2026-03-24 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13833c31-f406-53d9-9239-0ac3c5b01458 with identifier: 1981065
2026-03-24 18:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13833c31-f406-53d9-9239-0ac3c5b01458 with identifier: 1981065 to the API
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/184/c9edb198786b46a8b35c7946a238132a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '13833c31-f406-53d9-9239-0ac3c5b01458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 34434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13833c31-f406-53d9-9239-0ac3c5b01458/13833c31-f406-53d9-9239-0ac3c5b01458_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/184/c9edb198786b46a8b35c7946a238132a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L2H1 Energy BluedCi 70 kW',
 'transmission': 'manual',
 'trim': 'Furgon 29 L2H1 Energy BluedCi 70 kW',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981065%27 HTTP/1.1" 200 None
2026-03-24 18:30:55 [ayvens.es] INFO: Saving data for 1981065: {'created_time': 1774377055.632704, 'last_price_update_time': 1774377055.632715, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981065') HTTP/1.1" 204 0
2026-03-24 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f9efea71-1693-52fb-9743-17191af4395e with identifier: 1981064
2026-03-24 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f9efea71-1693-52fb-9743-17191af4395e with identifier: 1981064
2026-03-24 18:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f9efea71-1693-52fb-9743-17191af4395e with identifier: 1981064 to the API
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/696/86bf7ab85b11407b80278d48bc366761/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f9efea71-1693-52fb-9743-17191af4395e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 173851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9efea71-1693-52fb-9743-17191af4395e/f9efea71-1693-52fb-9743-17191af4395e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/696/86bf7ab85b11407b80278d48bc366761/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981064%27 HTTP/1.1" 200 None
2026-03-24 18:30:55 [ayvens.es] INFO: Saving data for 1981064: {'created_time': 1774377055.988746, 'last_price_update_time': 1774377055.988758, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981064') HTTP/1.1" 204 0
2026-03-24 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/108/3c91457a969d4e86888eba8dfc458a83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:56 [ayvens.es] INFO: Found listing with ID: 1981074
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981074%27 HTTP/1.1" 200 None
2026-03-24 18:30:56 [ayvens.es] INFO: Scrape type for 1981074: 1
2026-03-24 18:30:56 [ayvens.es] INFO: Extracting data for car ID: 1981074
2026-03-24 18:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1981074
2026-03-24 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e946aae-9411-5b17-b27d-4fab7de430d5 with scrape type 1
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e946aae-9411-5b17-b27d-4fab7de430d5
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F6bc456dfd8834733aeb5d4ce3ad0b248%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/6bc456dfd8834733aeb5d4ce3ad0b248/images/large/1.jpg not downloaded yet
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0600dd0>
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3003da29-6ac3-5e7e-ae27-b6e4d8a577ed/3003da29-6ac3-5e7e-ae27-b6e4d8a577ed_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F392e22f8d11d494c833d67b9dca750d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/392e22f8d11d494c833d67b9dca750d6/images/large/1.jpg saved to cache
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed
2026-03-24 18:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed, skipping ID generation
2026-03-24 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed with scrape type 1
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed sending to next pipeline
2026-03-24 18:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed, identifier: 1981066
2026-03-24 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/651/8ad12f73692c4ba79e5a0a326213bd15/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:56 [ayvens.es] INFO: Found listing with ID: 1981075
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981075%27 HTTP/1.1" 200 None
2026-03-24 18:30:56 [ayvens.es] INFO: Scrape type for 1981075: 1
2026-03-24 18:30:56 [ayvens.es] INFO: Extracting data for car ID: 1981075
2026-03-24 18:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f61e05-36c2-53d5-b7b1-10735bb4fce8 with identifier: 1981075
2026-03-24 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f61e05-36c2-53d5-b7b1-10735bb4fce8 with scrape type 1
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 12f61e05-36c2-53d5-b7b1-10735bb4fce8
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252F94dfb25577e04186ab1101b958955949%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/94dfb25577e04186ab1101b958955949/images/large/1.jpg not downloaded yet
2026-03-24 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed with identifier: 1981066
2026-03-24 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed with identifier: 1981066
2026-03-24 18:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3003da29-6ac3-5e7e-ae27-b6e4d8a577ed with identifier: 1981066 to the API
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/384/392e22f8d11d494c833d67b9dca750d6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3003da29-6ac3-5e7e-ae27-b6e4d8a577ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 124976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3003da29-6ac3-5e7e-ae27-b6e4d8a577ed/3003da29-6ac3-5e7e-ae27-b6e4d8a577ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/384/392e22f8d11d494c833d67b9dca750d6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981066%27 HTTP/1.1" 200 None
2026-03-24 18:30:56 [ayvens.es] INFO: Saving data for 1981066: {'created_time': 1774377056.774712, 'last_price_update_time': 1774377056.774723, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981066') HTTP/1.1" 204 0
2026-03-24 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/528/5eaf45d596e043df8c73498109c869fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/146/bb56f187cb99435d97a961390bb6502c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:56 [ayvens.es] INFO: Found listing with ID: 1981076
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981076%27 HTTP/1.1" 200 None
2026-03-24 18:30:56 [ayvens.es] INFO: Scrape type for 1981076: 1
2026-03-24 18:30:56 [ayvens.es] INFO: Extracting data for car ID: 1981076
2026-03-24 18:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a94c40-a6ba-5206-97fb-00405f5ac049 with identifier: 1981076
2026-03-24 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a94c40-a6ba-5206-97fb-00405f5ac049 with scrape type 1
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6a94c40-a6ba-5206-97fb-00405f5ac049
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252F776ab5ccb0cb4ae39a4a69921406349e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/776ab5ccb0cb4ae39a4a69921406349e/images/large/1.jpg not downloaded yet
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6fee10>
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86d0ba2e-f412-58da-af00-47fda2c264ef/86d0ba2e-f412-58da-af00-47fda2c264ef_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F3c91457a969d4e86888eba8dfc458a83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/3c91457a969d4e86888eba8dfc458a83/images/large/1.jpg saved to cache
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86d0ba2e-f412-58da-af00-47fda2c264ef
2026-03-24 18:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86d0ba2e-f412-58da-af00-47fda2c264ef, skipping ID generation
2026-03-24 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d0ba2e-f412-58da-af00-47fda2c264ef with scrape type 1
2026-03-24 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86d0ba2e-f412-58da-af00-47fda2c264ef sending to next pipeline
2026-03-24 18:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 86d0ba2e-f412-58da-af00-47fda2c264ef, identifier: 1981068
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee23c0d0>
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93588b6b-f9c7-5fb2-b00d-341665c84f13/93588b6b-f9c7-5fb2-b00d-341665c84f13_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F8ad12f73692c4ba79e5a0a326213bd15%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/8ad12f73692c4ba79e5a0a326213bd15/images/large/1.jpg saved to cache
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93588b6b-f9c7-5fb2-b00d-341665c84f13
2026-03-24 18:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93588b6b-f9c7-5fb2-b00d-341665c84f13, skipping ID generation
2026-03-24 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93588b6b-f9c7-5fb2-b00d-341665c84f13 with scrape type 1
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93588b6b-f9c7-5fb2-b00d-341665c84f13 sending to next pipeline
2026-03-24 18:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 93588b6b-f9c7-5fb2-b00d-341665c84f13, identifier: 1981067
2026-03-24 18:30:57 [ayvens.es] INFO: Found listing with ID: 1981077
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981077%27 HTTP/1.1" 200 None
2026-03-24 18:30:57 [ayvens.es] INFO: Scrape type for 1981077: 1
2026-03-24 18:30:57 [ayvens.es] INFO: Extracting data for car ID: 1981077
2026-03-24 18:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0 with identifier: 1981077
2026-03-24 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0 with scrape type 1
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252F29eaff79f68c4eb9be3a2e4b84a20b7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/29eaff79f68c4eb9be3a2e4b84a20b7e/images/large/1.jpg not downloaded yet
2026-03-24 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1981068
2026-03-24 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1981068
2026-03-24 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1981068 to the API
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/108/3c91457a969d4e86888eba8dfc458a83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '86d0ba2e-f412-58da-af00-47fda2c264ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 231323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86d0ba2e-f412-58da-af00-47fda2c264ef/86d0ba2e-f412-58da-af00-47fda2c264ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/108/3c91457a969d4e86888eba8dfc458a83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'transmission': 'manual',
 'trim': '2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'vin': None,
 'year': 2021}
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981068%27 HTTP/1.1" 200 None
2026-03-24 18:30:57 [ayvens.es] INFO: Saving data for 1981068: {'created_time': 1774377057.5057, 'last_price_update_time': 1774377057.505711, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981068') HTTP/1.1" 204 0
2026-03-24 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1981067
2026-03-24 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1981067
2026-03-24 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1981067 to the API
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/651/8ad12f73692c4ba79e5a0a326213bd15/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '93588b6b-f9c7-5fb2-b00d-341665c84f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPER',
 'odometer': 77669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93588b6b-f9c7-5fb2-b00d-341665c84f13/93588b6b-f9c7-5fb2-b00d-341665c84f13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/651/8ad12f73692c4ba79e5a0a326213bd15/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPER BlueHDi 96KW (130CV) Furgon 33L2H1',
 'transmission': 'manual',
 'trim': 'BlueHDi 96KW (130CV) Furgon 33L2H1',
 'vin': None,
 'year': 2019}
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981067%27 HTTP/1.1" 200 None
2026-03-24 18:30:57 [ayvens.es] INFO: Saving data for 1981067: {'created_time': 1774377057.833289, 'last_price_update_time': 1774377057.833299, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981067') HTTP/1.1" 204 0
2026-03-24 18:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/821/a9481a0610e445959358fd8e32c0f619/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:57 [ayvens.es] INFO: Found listing with ID: 1981078
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981078%27 HTTP/1.1" 200 None
2026-03-24 18:30:57 [ayvens.es] INFO: Scrape type for 1981078: 1
2026-03-24 18:30:57 [ayvens.es] INFO: Extracting data for car ID: 1981078
2026-03-24 18:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e575dd1f-ce97-5bdd-943e-d290b1e221aa with identifier: 1981078
2026-03-24 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e575dd1f-ce97-5bdd-943e-d290b1e221aa with scrape type 1
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e575dd1f-ce97-5bdd-943e-d290b1e221aa
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F507%252Fc3692dd47b384cff8227a650946c56d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/507/c3692dd47b384cff8227a650946c56d0/images/large/1.jpg not downloaded yet
2026-03-24 18:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/431/5401872513c748cf80e37657df6136b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed35410>
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a97ab4-6ede-5e42-b8c3-cb703c95c2af/d3a97ab4-6ede-5e42-b8c3-cb703c95c2af_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F528%252F5eaf45d596e043df8c73498109c869fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/528/5eaf45d596e043df8c73498109c869fa/images/large/1.jpg saved to cache
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3a97ab4-6ede-5e42-b8c3-cb703c95c2af
2026-03-24 18:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3a97ab4-6ede-5e42-b8c3-cb703c95c2af, skipping ID generation
2026-03-24 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a97ab4-6ede-5e42-b8c3-cb703c95c2af with scrape type 1
2026-03-24 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3a97ab4-6ede-5e42-b8c3-cb703c95c2af sending to next pipeline
2026-03-24 18:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3a97ab4-6ede-5e42-b8c3-cb703c95c2af, identifier: 1981070
2026-03-24 18:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee209590>
2026-03-24 18:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add41c3a-84e0-5deb-b366-32c332cf7eb3/add41c3a-84e0-5deb-b366-32c332cf7eb3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F146%252Fbb56f187cb99435d97a961390bb6502c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/146/bb56f187cb99435d97a961390bb6502c/images/large/1.jpg saved to cache
2026-03-24 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item add41c3a-84e0-5deb-b366-32c332cf7eb3
2026-03-24 18:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: add41c3a-84e0-5deb-b366-32c332cf7eb3, skipping ID generation
2026-03-24 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add41c3a-84e0-5deb-b366-32c332cf7eb3 with scrape type 1
2026-03-24 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item add41c3a-84e0-5deb-b366-32c332cf7eb3 sending to next pipeline
2026-03-24 18:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: add41c3a-84e0-5deb-b366-32c332cf7eb3, identifier: 1981069
2026-03-24 18:30:58 [ayvens.es] INFO: Found listing with ID: 1981079
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981079%27 HTTP/1.1" 200 None
2026-03-24 18:30:58 [ayvens.es] INFO: Scrape type for 1981079: 1
2026-03-24 18:30:58 [ayvens.es] INFO: Extracting data for car ID: 1981079
2026-03-24 18:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849a81c3-e334-5f76-8e37-efe3e35c78b3 with identifier: 1981079
2026-03-24 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849a81c3-e334-5f76-8e37-efe3e35c78b3 with scrape type 1
2026-03-24 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 849a81c3-e334-5f76-8e37-efe3e35c78b3
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252Fa3c9790156af406fba0cc895ebc277bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/a3c9790156af406fba0cc895ebc277bc/images/large/1.jpg not downloaded yet
2026-03-24 18:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3a97ab4-6ede-5e42-b8c3-cb703c95c2af with identifier: 1981070
2026-03-24 18:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3a97ab4-6ede-5e42-b8c3-cb703c95c2af with identifier: 1981070
2026-03-24 18:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3a97ab4-6ede-5e42-b8c3-cb703c95c2af with identifier: 1981070 to the API
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/528/5eaf45d596e043df8c73498109c869fa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3a97ab4-6ede-5e42-b8c3-cb703c95c2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 202868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3a97ab4-6ede-5e42-b8c3-cb703c95c2af/d3a97ab4-6ede-5e42-b8c3-cb703c95c2af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/528/5eaf45d596e043df8c73498109c869fa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2020}
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981070%27 HTTP/1.1" 200 None
2026-03-24 18:30:58 [ayvens.es] INFO: Saving data for 1981070: {'created_time': 1774377058.640191, 'last_price_update_time': 1774377058.640201, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981070') HTTP/1.1" 204 0
2026-03-24 18:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1981069
2026-03-24 18:30:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1981069
2026-03-24 18:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1981069 to the API
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/146/bb56f187cb99435d97a961390bb6502c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'add41c3a-84e0-5deb-b366-32c332cf7eb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 112521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add41c3a-84e0-5deb-b366-32c332cf7eb3/add41c3a-84e0-5deb-b366-32c332cf7eb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/146/bb56f187cb99435d97a961390bb6502c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 300 L2 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 300 L2 Trend',
 'vin': None,
 'year': 2022}
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981069%27 HTTP/1.1" 200 None
2026-03-24 18:30:58 [ayvens.es] INFO: Saving data for 1981069: {'created_time': 1774377058.980189, 'last_price_update_time': 1774377058.980201, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981069') HTTP/1.1" 204 0
2026-03-24 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/168/3254c8f36298453a861bfed7652ac514/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:59 [ayvens.es] INFO: Found listing with ID: 1981080
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981080%27 HTTP/1.1" 200 None
2026-03-24 18:30:59 [ayvens.es] INFO: Scrape type for 1981080: 1
2026-03-24 18:30:59 [ayvens.es] INFO: Extracting data for car ID: 1981080
2026-03-24 18:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d482281-c9ac-56b7-a2bd-74220bfe241d with identifier: 1981080
2026-03-24 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d482281-c9ac-56b7-a2bd-74220bfe241d with scrape type 1
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0d482281-c9ac-56b7-a2bd-74220bfe241d
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F707%252F9aa53450e5174023b516829e89f67176%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/707/9aa53450e5174023b516829e89f67176/images/large/1.jpg not downloaded yet
2026-03-24 18:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/993/6bc456dfd8834733aeb5d4ce3ad0b248/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a1790>
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7ae69a0-b711-5f13-a758-ded18bc086bb/f7ae69a0-b711-5f13-a758-ded18bc086bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F821%252Fa9481a0610e445959358fd8e32c0f619%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/821/a9481a0610e445959358fd8e32c0f619/images/large/1.jpg saved to cache
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7ae69a0-b711-5f13-a758-ded18bc086bb
2026-03-24 18:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7ae69a0-b711-5f13-a758-ded18bc086bb, skipping ID generation
2026-03-24 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ae69a0-b711-5f13-a758-ded18bc086bb with scrape type 1
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7ae69a0-b711-5f13-a758-ded18bc086bb sending to next pipeline
2026-03-24 18:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f7ae69a0-b711-5f13-a758-ded18bc086bb, identifier: 1981071
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a1050>
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc862372-0044-50dc-ba18-63ffd1951670/fc862372-0044-50dc-ba18-63ffd1951670_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F431%252F5401872513c748cf80e37657df6136b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/431/5401872513c748cf80e37657df6136b3/images/large/1.jpg saved to cache
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc862372-0044-50dc-ba18-63ffd1951670
2026-03-24 18:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc862372-0044-50dc-ba18-63ffd1951670, skipping ID generation
2026-03-24 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc862372-0044-50dc-ba18-63ffd1951670 with scrape type 1
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc862372-0044-50dc-ba18-63ffd1951670 sending to next pipeline
2026-03-24 18:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fc862372-0044-50dc-ba18-63ffd1951670, identifier: 1981072
2026-03-24 18:30:59 [ayvens.es] INFO: Found listing with ID: 1981081
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981081%27 HTTP/1.1" 200 None
2026-03-24 18:30:59 [ayvens.es] INFO: Scrape type for 1981081: 1
2026-03-24 18:30:59 [ayvens.es] INFO: Extracting data for car ID: 1981081
2026-03-24 18:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1981081
2026-03-24 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932baa27-d627-5243-a517-a8421ac761bd with scrape type 1
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 932baa27-d627-5243-a517-a8421ac761bd
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252F9d6b33964c9148a38d5c8a31a459e8a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/9d6b33964c9148a38d5c8a31a459e8a2/images/large/1.jpg not downloaded yet
2026-03-24 18:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f7ae69a0-b711-5f13-a758-ded18bc086bb with identifier: 1981071
2026-03-24 18:30:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f7ae69a0-b711-5f13-a758-ded18bc086bb with identifier: 1981071
2026-03-24 18:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f7ae69a0-b711-5f13-a758-ded18bc086bb with identifier: 1981071 to the API
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/821/a9481a0610e445959358fd8e32c0f619/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f7ae69a0-b711-5f13-a758-ded18bc086bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 52749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7ae69a0-b711-5f13-a758-ded18bc086bb/f7ae69a0-b711-5f13-a758-ded18bc086bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/821/a9481a0610e445959358fd8e32c0f619/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2023}
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981071%27 HTTP/1.1" 200 None
2026-03-24 18:30:59 [ayvens.es] INFO: Saving data for 1981071: {'created_time': 1774377059.682156, 'last_price_update_time': 1774377059.682166, 'auction_closing_time': 1774440000.0}
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981071') HTTP/1.1" 204 0
2026-03-24 18:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fc862372-0044-50dc-ba18-63ffd1951670 with identifier: 1981072
2026-03-24 18:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fc862372-0044-50dc-ba18-63ffd1951670 with identifier: 1981072
2026-03-24 18:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fc862372-0044-50dc-ba18-63ffd1951670 with identifier: 1981072 to the API
2026-03-24 18:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/431/5401872513c748cf80e37657df6136b3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco opaca',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fc862372-0044-50dc-ba18-63ffd1951670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 149004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc862372-0044-50dc-ba18-63ffd1951670/fc862372-0044-50dc-ba18-63ffd1951670_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/431/5401872513c748cf80e37657df6136b3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981072%27 HTTP/1.1" 200 None
2026-03-24 18:31:00 [ayvens.es] INFO: Saving data for 1981072: {'created_time': 1774377060.108266, 'last_price_update_time': 1774377060.108282, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981072') HTTP/1.1" 204 0
2026-03-24 18:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/736/94dfb25577e04186ab1101b958955949/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/372/776ab5ccb0cb4ae39a4a69921406349e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:00 [ayvens.es] INFO: Found listing with ID: 1981082
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981082%27 HTTP/1.1" 200 None
2026-03-24 18:31:00 [ayvens.es] INFO: Scrape type for 1981082: 1
2026-03-24 18:31:00 [ayvens.es] INFO: Extracting data for car ID: 1981082
2026-03-24 18:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040bbae0-b555-5b18-8ebc-6ce4260db66d with identifier: 1981082
2026-03-24 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040bbae0-b555-5b18-8ebc-6ce4260db66d with scrape type 1
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 040bbae0-b555-5b18-8ebc-6ce4260db66d
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252F2985f978e6fb45b2a0c1e45f81739a97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/2985f978e6fb45b2a0c1e45f81739a97/images/large/1.jpg not downloaded yet
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a2390>
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef/b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F168%252F3254c8f36298453a861bfed7652ac514%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/168/3254c8f36298453a861bfed7652ac514/images/large/1.jpg saved to cache
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef
2026-03-24 18:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef, skipping ID generation
2026-03-24 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with scrape type 1
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef sending to next pipeline
2026-03-24 18:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef, identifier: 1981073
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee708710>
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e946aae-9411-5b17-b27d-4fab7de430d5/2e946aae-9411-5b17-b27d-4fab7de430d5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F6bc456dfd8834733aeb5d4ce3ad0b248%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/6bc456dfd8834733aeb5d4ce3ad0b248/images/large/1.jpg saved to cache
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e946aae-9411-5b17-b27d-4fab7de430d5
2026-03-24 18:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e946aae-9411-5b17-b27d-4fab7de430d5, skipping ID generation
2026-03-24 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e946aae-9411-5b17-b27d-4fab7de430d5 with scrape type 1
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e946aae-9411-5b17-b27d-4fab7de430d5 sending to next pipeline
2026-03-24 18:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2e946aae-9411-5b17-b27d-4fab7de430d5, identifier: 1981074
2026-03-24 18:31:00 [ayvens.es] INFO: Found listing with ID: 1981083
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981083%27 HTTP/1.1" 200 None
2026-03-24 18:31:00 [ayvens.es] INFO: Scrape type for 1981083: 1
2026-03-24 18:31:00 [ayvens.es] INFO: Extracting data for car ID: 1981083
2026-03-24 18:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1981083
2026-03-24 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c8051ed-2b05-5b44-946b-4068fb780f3c with scrape type 1
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c8051ed-2b05-5b44-946b-4068fb780f3c
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252Fa0eda3949739483c974d715269db3afc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/a0eda3949739483c974d715269db3afc/images/large/1.jpg not downloaded yet
2026-03-24 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1981073
2026-03-24 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1981073
2026-03-24 18:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1981073 to the API
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/168/3254c8f36298453a861bfed7652ac514/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura blanco glaci',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 165578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef/b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/168/3254c8f36298453a861bfed7652ac514/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981073%27 HTTP/1.1" 200 None
2026-03-24 18:31:00 [ayvens.es] INFO: Saving data for 1981073: {'created_time': 1774377060.896632, 'last_price_update_time': 1774377060.896642, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981073') HTTP/1.1" 204 0
2026-03-24 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1981074
2026-03-24 18:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1981074
2026-03-24 18:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1981074 to the API
2026-03-24 18:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/993/6bc456dfd8834733aeb5d4ce3ad0b248/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2e946aae-9411-5b17-b27d-4fab7de430d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 150135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e946aae-9411-5b17-b27d-4fab7de430d5/2e946aae-9411-5b17-b27d-4fab7de430d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/993/6bc456dfd8834733aeb5d4ce3ad0b248/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981074%27 HTTP/1.1" 200 None
2026-03-24 18:31:01 [ayvens.es] INFO: Saving data for 1981074: {'created_time': 1774377061.232518, 'last_price_update_time': 1774377061.232528, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981074') HTTP/1.1" 204 0
2026-03-24 18:31:01 [ayvens.es] INFO: Found listing with ID: 1981084
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981084%27 HTTP/1.1" 200 None
2026-03-24 18:31:01 [ayvens.es] INFO: Scrape type for 1981084: 1
2026-03-24 18:31:01 [ayvens.es] INFO: Extracting data for car ID: 1981084
2026-03-24 18:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 968ce7e3-3804-53d4-af4b-6fb040a356d0 with identifier: 1981084
2026-03-24 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 968ce7e3-3804-53d4-af4b-6fb040a356d0 with scrape type 1
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 968ce7e3-3804-53d4-af4b-6fb040a356d0
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252Fb710121cf13f404686a713c0b4c6bb15%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/b710121cf13f404686a713c0b4c6bb15/images/large/1.jpg not downloaded yet
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6f5a90>
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f61e05-36c2-53d5-b7b1-10735bb4fce8/12f61e05-36c2-53d5-b7b1-10735bb4fce8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252F94dfb25577e04186ab1101b958955949%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/94dfb25577e04186ab1101b958955949/images/large/1.jpg saved to cache
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12f61e05-36c2-53d5-b7b1-10735bb4fce8
2026-03-24 18:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12f61e05-36c2-53d5-b7b1-10735bb4fce8, skipping ID generation
2026-03-24 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f61e05-36c2-53d5-b7b1-10735bb4fce8 with scrape type 1
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12f61e05-36c2-53d5-b7b1-10735bb4fce8 sending to next pipeline
2026-03-24 18:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 12f61e05-36c2-53d5-b7b1-10735bb4fce8, identifier: 1981075
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea95350>
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a94c40-a6ba-5206-97fb-00405f5ac049/d6a94c40-a6ba-5206-97fb-00405f5ac049_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252F776ab5ccb0cb4ae39a4a69921406349e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/776ab5ccb0cb4ae39a4a69921406349e/images/large/1.jpg saved to cache
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6a94c40-a6ba-5206-97fb-00405f5ac049
2026-03-24 18:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6a94c40-a6ba-5206-97fb-00405f5ac049, skipping ID generation
2026-03-24 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a94c40-a6ba-5206-97fb-00405f5ac049 with scrape type 1
2026-03-24 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6a94c40-a6ba-5206-97fb-00405f5ac049 sending to next pipeline
2026-03-24 18:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6a94c40-a6ba-5206-97fb-00405f5ac049, identifier: 1981076
2026-03-24 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 12f61e05-36c2-53d5-b7b1-10735bb4fce8 with identifier: 1981075
2026-03-24 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 12f61e05-36c2-53d5-b7b1-10735bb4fce8 with identifier: 1981075
2026-03-24 18:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 12f61e05-36c2-53d5-b7b1-10735bb4fce8 with identifier: 1981075 to the API
2026-03-24 18:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/736/94dfb25577e04186ab1101b958955949/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '12f61e05-36c2-53d5-b7b1-10735bb4fce8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 195038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f61e05-36c2-53d5-b7b1-10735bb4fce8/12f61e05-36c2-53d5-b7b1-10735bb4fce8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/736/94dfb25577e04186ab1101b958955949/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981075%27 HTTP/1.1" 200 None
2026-03-24 18:31:02 [ayvens.es] INFO: Saving data for 1981075: {'created_time': 1774377062.655762, 'last_price_update_time': 1774377062.655775, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981075') HTTP/1.1" 204 0
2026-03-24 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6a94c40-a6ba-5206-97fb-00405f5ac049 with identifier: 1981076
2026-03-24 18:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6a94c40-a6ba-5206-97fb-00405f5ac049 with identifier: 1981076
2026-03-24 18:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6a94c40-a6ba-5206-97fb-00405f5ac049 with identifier: 1981076 to the API
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/372/776ab5ccb0cb4ae39a4a69921406349e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6a94c40-a6ba-5206-97fb-00405f5ac049',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 195551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a94c40-a6ba-5206-97fb-00405f5ac049/d6a94c40-a6ba-5206-97fb-00405f5ac049_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/776ab5ccb0cb4ae39a4a69921406349e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981076%27 HTTP/1.1" 200 None
2026-03-24 18:31:02 [ayvens.es] INFO: Saving data for 1981076: {'created_time': 1774377062.975623, 'last_price_update_time': 1774377062.975633, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981076') HTTP/1.1" 204 0
2026-03-24 18:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/453/29eaff79f68c4eb9be3a2e4b84a20b7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:02 [ayvens.es] INFO: Found listing with ID: 1981085
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981085%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [ayvens.es] INFO: Scrape type for 1981085: 1
2026-03-24 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1981085
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1981085
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6713a55-41ce-5ab2-9422-56ccbb1db148 with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6713a55-41ce-5ab2-9422-56ccbb1db148
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F88e9d2c6c7804cd785cd1f54fe24844f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/88e9d2c6c7804cd785cd1f54fe24844f/images/large/1.jpg not downloaded yet
2026-03-24 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/507/c3692dd47b384cff8227a650946c56d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/707/9aa53450e5174023b516829e89f67176/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:03 [ayvens.es] INFO: Found listing with ID: 1981086
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981086%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [ayvens.es] INFO: Scrape type for 1981086: 1
2026-03-24 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1981086
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1981086
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1810c7de-7328-57b8-a689-3ecd7dd45941 with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1810c7de-7328-57b8-a689-3ecd7dd45941
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F59517c41fdc84bf4acaf45abedf7bbd7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/59517c41fdc84bf4acaf45abedf7bbd7/images/large/1.jpg not downloaded yet
2026-03-24 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/721/a3c9790156af406fba0cc895ebc277bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:03 [ayvens.es] INFO: Found listing with ID: 1981087
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981087%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [ayvens.es] INFO: Scrape type for 1981087: 1
2026-03-24 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1981087
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92126090-b061-51be-8132-b96367b4e951 with identifier: 1981087
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92126090-b061-51be-8132-b96367b4e951 with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92126090-b061-51be-8132-b96367b4e951
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F17bc536bb1d34c96990f2a3b87a6c1af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/17bc536bb1d34c96990f2a3b87a6c1af/images/large/1.jpg not downloaded yet
2026-03-24 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/760/2985f978e6fb45b2a0c1e45f81739a97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/703/9d6b33964c9148a38d5c8a31a459e8a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:03 [ayvens.es] INFO: Found listing with ID: 1981088
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981088%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [ayvens.es] INFO: Scrape type for 1981088: 1
2026-03-24 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1981088
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1981088
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae044edb-102c-58a4-8eea-d0f9b6589450 with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ae044edb-102c-58a4-8eea-d0f9b6589450
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F633%252F0a7e9c37bbea43aeb04f341f27c9ea53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/633/0a7e9c37bbea43aeb04f341f27c9ea53/images/large/1.jpg not downloaded yet
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef6a550>
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91d344e5-63b5-5a5b-b05b-a43eb1d21ed0/91d344e5-63b5-5a5b-b05b-a43eb1d21ed0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252F29eaff79f68c4eb9be3a2e4b84a20b7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/29eaff79f68c4eb9be3a2e4b84a20b7e/images/large/1.jpg saved to cache
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0, skipping ID generation
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0 with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0 sending to next pipeline
2026-03-24 18:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0, identifier: 1981077
2026-03-24 18:31:03 [ayvens.es] INFO: Found listing with ID: 1981089
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981089%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [ayvens.es] INFO: Scrape type for 1981089: 1
2026-03-24 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1981089
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ce51ee-f381-58d9-8c17-80175aa29e82 with identifier: 1981089
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ce51ee-f381-58d9-8c17-80175aa29e82 with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 67ce51ee-f381-58d9-8c17-80175aa29e82
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F347%252F6c4aa3ebdec94221aaad5b0a4311b281%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/347/6c4aa3ebdec94221aaad5b0a4311b281/images/large/1.jpg not downloaded yet
2026-03-24 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0 with identifier: 1981077
2026-03-24 18:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0 with identifier: 1981077
2026-03-24 18:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 91d344e5-63b5-5a5b-b05b-a43eb1d21ed0 with identifier: 1981077 to the API
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/453/29eaff79f68c4eb9be3a2e4b84a20b7e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '91d344e5-63b5-5a5b-b05b-a43eb1d21ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 95708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91d344e5-63b5-5a5b-b05b-a43eb1d21ed0/91d344e5-63b5-5a5b-b05b-a43eb1d21ed0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/453/29eaff79f68c4eb9be3a2e4b84a20b7e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 29 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981077%27 HTTP/1.1" 200 None
2026-03-24 18:31:03 [ayvens.es] INFO: Saving data for 1981077: {'created_time': 1774377063.681271, 'last_price_update_time': 1774377063.681282, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981077') HTTP/1.1" 204 0
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee20b650>
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e575dd1f-ce97-5bdd-943e-d290b1e221aa/e575dd1f-ce97-5bdd-943e-d290b1e221aa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F507%252Fc3692dd47b384cff8227a650946c56d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/507/c3692dd47b384cff8227a650946c56d0/images/large/1.jpg saved to cache
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e575dd1f-ce97-5bdd-943e-d290b1e221aa
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e575dd1f-ce97-5bdd-943e-d290b1e221aa, skipping ID generation
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e575dd1f-ce97-5bdd-943e-d290b1e221aa with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e575dd1f-ce97-5bdd-943e-d290b1e221aa sending to next pipeline
2026-03-24 18:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e575dd1f-ce97-5bdd-943e-d290b1e221aa, identifier: 1981078
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6b6c90>
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d482281-c9ac-56b7-a2bd-74220bfe241d/0d482281-c9ac-56b7-a2bd-74220bfe241d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F707%252F9aa53450e5174023b516829e89f67176%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/707/9aa53450e5174023b516829e89f67176/images/large/1.jpg saved to cache
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d482281-c9ac-56b7-a2bd-74220bfe241d
2026-03-24 18:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d482281-c9ac-56b7-a2bd-74220bfe241d, skipping ID generation
2026-03-24 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d482281-c9ac-56b7-a2bd-74220bfe241d with scrape type 1
2026-03-24 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d482281-c9ac-56b7-a2bd-74220bfe241d sending to next pipeline
2026-03-24 18:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0d482281-c9ac-56b7-a2bd-74220bfe241d, identifier: 1981080
2026-03-24 18:31:04 [ayvens.es] INFO: Found listing with ID: 1981090
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981090%27 HTTP/1.1" 200 None
2026-03-24 18:31:04 [ayvens.es] INFO: Scrape type for 1981090: 1
2026-03-24 18:31:04 [ayvens.es] INFO: Extracting data for car ID: 1981090
2026-03-24 18:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb948f05-429d-566e-a6ae-d60c9276b615 with identifier: 1981090
2026-03-24 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb948f05-429d-566e-a6ae-d60c9276b615 with scrape type 1
2026-03-24 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb948f05-429d-566e-a6ae-d60c9276b615
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F700%252Ff86949ff4cd940f9b2ac274cff33e863%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/700/f86949ff4cd940f9b2ac274cff33e863/images/large/1.jpg not downloaded yet
2026-03-24 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e575dd1f-ce97-5bdd-943e-d290b1e221aa with identifier: 1981078
2026-03-24 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e575dd1f-ce97-5bdd-943e-d290b1e221aa with identifier: 1981078
2026-03-24 18:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e575dd1f-ce97-5bdd-943e-d290b1e221aa with identifier: 1981078 to the API
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/507/c3692dd47b384cff8227a650946c56d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'color': 'Ic',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e575dd1f-ce97-5bdd-943e-d290b1e221aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'IVECO',
 'model': 'DAILY',
 'odometer': 197095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e575dd1f-ce97-5bdd-943e-d290b1e221aa/e575dd1f-ce97-5bdd-943e-d290b1e221aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/507/c3692dd47b384cff8227a650946c56d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'IVECO DAILY 35C 18H A8 3750',
 'transmission': 'manual',
 'trim': '35C 18H A8 3750',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981078%27 HTTP/1.1" 200 None
2026-03-24 18:31:04 [ayvens.es] INFO: Saving data for 1981078: {'created_time': 1774377064.468285, 'last_price_update_time': 1774377064.468297, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981078') HTTP/1.1" 204 0
2026-03-24 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0d482281-c9ac-56b7-a2bd-74220bfe241d with identifier: 1981080
2026-03-24 18:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0d482281-c9ac-56b7-a2bd-74220bfe241d with identifier: 1981080
2026-03-24 18:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0d482281-c9ac-56b7-a2bd-74220bfe241d with identifier: 1981080 to the API
2026-03-24 18:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/707/9aa53450e5174023b516829e89f67176/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0d482281-c9ac-56b7-a2bd-74220bfe241d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 117572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d482281-c9ac-56b7-a2bd-74220bfe241d/0d482281-c9ac-56b7-a2bd-74220bfe241d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/707/9aa53450e5174023b516829e89f67176/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981080%27 HTTP/1.1" 200 None
2026-03-24 18:31:05 [ayvens.es] INFO: Saving data for 1981080: {'created_time': 1774377065.372693, 'last_price_update_time': 1774377065.372704, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981080') HTTP/1.1" 204 0
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6b6050>
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849a81c3-e334-5f76-8e37-efe3e35c78b3/849a81c3-e334-5f76-8e37-efe3e35c78b3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252Fa3c9790156af406fba0cc895ebc277bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/a3c9790156af406fba0cc895ebc277bc/images/large/1.jpg saved to cache
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 849a81c3-e334-5f76-8e37-efe3e35c78b3
2026-03-24 18:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 849a81c3-e334-5f76-8e37-efe3e35c78b3, skipping ID generation
2026-03-24 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849a81c3-e334-5f76-8e37-efe3e35c78b3 with scrape type 1
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 849a81c3-e334-5f76-8e37-efe3e35c78b3 sending to next pipeline
2026-03-24 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 849a81c3-e334-5f76-8e37-efe3e35c78b3, identifier: 1981079
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea97dd0>
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040bbae0-b555-5b18-8ebc-6ce4260db66d/040bbae0-b555-5b18-8ebc-6ce4260db66d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252F2985f978e6fb45b2a0c1e45f81739a97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/2985f978e6fb45b2a0c1e45f81739a97/images/large/1.jpg saved to cache
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 040bbae0-b555-5b18-8ebc-6ce4260db66d
2026-03-24 18:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 040bbae0-b555-5b18-8ebc-6ce4260db66d, skipping ID generation
2026-03-24 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040bbae0-b555-5b18-8ebc-6ce4260db66d with scrape type 1
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 040bbae0-b555-5b18-8ebc-6ce4260db66d sending to next pipeline
2026-03-24 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 040bbae0-b555-5b18-8ebc-6ce4260db66d, identifier: 1981082
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea0a690>
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932baa27-d627-5243-a517-a8421ac761bd/932baa27-d627-5243-a517-a8421ac761bd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252F9d6b33964c9148a38d5c8a31a459e8a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/9d6b33964c9148a38d5c8a31a459e8a2/images/large/1.jpg saved to cache
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 932baa27-d627-5243-a517-a8421ac761bd
2026-03-24 18:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 932baa27-d627-5243-a517-a8421ac761bd, skipping ID generation
2026-03-24 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932baa27-d627-5243-a517-a8421ac761bd with scrape type 1
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 932baa27-d627-5243-a517-a8421ac761bd sending to next pipeline
2026-03-24 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 932baa27-d627-5243-a517-a8421ac761bd, identifier: 1981081
2026-03-24 18:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/592/a0eda3949739483c974d715269db3afc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:05 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 58 items (at 58 items/min)
2026-03-24 18:31:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-24 18:31:05 [ayvens.es] INFO: Found listing with ID: 1981091
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981091%27 HTTP/1.1" 200 None
2026-03-24 18:31:05 [ayvens.es] INFO: Scrape type for 1981091: 1
2026-03-24 18:31:05 [ayvens.es] INFO: Extracting data for car ID: 1981091
2026-03-24 18:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1981091
2026-03-24 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8af016-8aef-5cb2-8887-0444d747e2c9 with scrape type 1
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9f8af016-8aef-5cb2-8887-0444d747e2c9
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F7ef94db0390f48b08ddfee31fe1b78ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/7ef94db0390f48b08ddfee31fe1b78ac/images/large/1.jpg not downloaded yet
2026-03-24 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 849a81c3-e334-5f76-8e37-efe3e35c78b3 with identifier: 1981079
2026-03-24 18:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 849a81c3-e334-5f76-8e37-efe3e35c78b3 with identifier: 1981079
2026-03-24 18:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 849a81c3-e334-5f76-8e37-efe3e35c78b3 with identifier: 1981079 to the API
2026-03-24 18:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/721/a3c9790156af406fba0cc895ebc277bc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '849a81c3-e334-5f76-8e37-efe3e35c78b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 82169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849a81c3-e334-5f76-8e37-efe3e35c78b3/849a81c3-e334-5f76-8e37-efe3e35c78b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/721/a3c9790156af406fba0cc895ebc277bc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981079%27 HTTP/1.1" 200 None
2026-03-24 18:31:06 [ayvens.es] INFO: Saving data for 1981079: {'created_time': 1774377066.268513, 'last_price_update_time': 1774377066.268524, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981079') HTTP/1.1" 204 0
2026-03-24 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 040bbae0-b555-5b18-8ebc-6ce4260db66d with identifier: 1981082
2026-03-24 18:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 040bbae0-b555-5b18-8ebc-6ce4260db66d with identifier: 1981082
2026-03-24 18:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 040bbae0-b555-5b18-8ebc-6ce4260db66d with identifier: 1981082 to the API
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/760/2985f978e6fb45b2a0c1e45f81739a97/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '040bbae0-b555-5b18-8ebc-6ce4260db66d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 109926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040bbae0-b555-5b18-8ebc-6ce4260db66d/040bbae0-b555-5b18-8ebc-6ce4260db66d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/760/2985f978e6fb45b2a0c1e45f81739a97/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981082%27 HTTP/1.1" 200 None
2026-03-24 18:31:06 [ayvens.es] INFO: Saving data for 1981082: {'created_time': 1774377066.598854, 'last_price_update_time': 1774377066.598864, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981082') HTTP/1.1" 204 0
2026-03-24 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1981081
2026-03-24 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1981081
2026-03-24 18:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1981081 to the API
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/703/9d6b33964c9148a38d5c8a31a459e8a2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco hielo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '932baa27-d627-5243-a517-a8421ac761bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV300',
 'odometer': 210273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932baa27-d627-5243-a517-a8421ac761bd/932baa27-d627-5243-a517-a8421ac761bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/703/9d6b33964c9148a38d5c8a31a459e8a2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV300 2.0dCi 107kW (145CV) L1H2 1,2T Comfort',
 'transmission': 'manual',
 'trim': '2.0dCi 107kW (145CV) L1H2 1,2T Comfort',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981081%27 HTTP/1.1" 200 None
2026-03-24 18:31:06 [ayvens.es] INFO: Saving data for 1981081: {'created_time': 1774377066.944889, 'last_price_update_time': 1774377066.944899, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981081') HTTP/1.1" 204 0
2026-03-24 18:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/948/59517c41fdc84bf4acaf45abedf7bbd7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/357/b710121cf13f404686a713c0b4c6bb15/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:06 [ayvens.es] INFO: Found listing with ID: 1981092
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981092%27 HTTP/1.1" 200 None
2026-03-24 18:31:06 [ayvens.es] INFO: Scrape type for 1981092: 1
2026-03-24 18:31:06 [ayvens.es] INFO: Extracting data for car ID: 1981092
2026-03-24 18:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa528d81-9e42-55a9-bae0-13e92ec2a953 with identifier: 1981092
2026-03-24 18:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa528d81-9e42-55a9-bae0-13e92ec2a953 with scrape type 1
2026-03-24 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aa528d81-9e42-55a9-bae0-13e92ec2a953
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252Fc12814d3ed9c4bb8be86521f8f557301%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/c12814d3ed9c4bb8be86521f8f557301/images/large/1.jpg not downloaded yet
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee38350>
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c8051ed-2b05-5b44-946b-4068fb780f3c/2c8051ed-2b05-5b44-946b-4068fb780f3c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252Fa0eda3949739483c974d715269db3afc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/a0eda3949739483c974d715269db3afc/images/large/1.jpg saved to cache
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c8051ed-2b05-5b44-946b-4068fb780f3c
2026-03-24 18:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c8051ed-2b05-5b44-946b-4068fb780f3c, skipping ID generation
2026-03-24 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c8051ed-2b05-5b44-946b-4068fb780f3c with scrape type 1
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c8051ed-2b05-5b44-946b-4068fb780f3c sending to next pipeline
2026-03-24 18:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2c8051ed-2b05-5b44-946b-4068fb780f3c, identifier: 1981083
2026-03-24 18:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/705/88e9d2c6c7804cd785cd1f54fe24844f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/633/0a7e9c37bbea43aeb04f341f27c9ea53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:07 [ayvens.es] INFO: Found listing with ID: 1981093
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981093%27 HTTP/1.1" 200 None
2026-03-24 18:31:07 [ayvens.es] INFO: Scrape type for 1981093: 1
2026-03-24 18:31:07 [ayvens.es] INFO: Extracting data for car ID: 1981093
2026-03-24 18:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1981093
2026-03-24 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with scrape type 1
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252F2f815d5577d34af587d68c9d8c162d01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/2f815d5577d34af587d68c9d8c162d01/images/large/1.jpg not downloaded yet
2026-03-24 18:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1981083
2026-03-24 18:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1981083
2026-03-24 18:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1981083 to the API
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/592/a0eda3949739483c974d715269db3afc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2c8051ed-2b05-5b44-946b-4068fb780f3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 160456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c8051ed-2b05-5b44-946b-4068fb780f3c/2c8051ed-2b05-5b44-946b-4068fb780f3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/592/a0eda3949739483c974d715269db3afc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981083%27 HTTP/1.1" 200 None
2026-03-24 18:31:07 [ayvens.es] INFO: Saving data for 1981083: {'created_time': 1774377067.600704, 'last_price_update_time': 1774377067.600713, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981083') HTTP/1.1" 204 0
2026-03-24 18:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/531/17bc536bb1d34c96990f2a3b87a6c1af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:07 [ayvens.es] INFO: Found listing with ID: 1981094
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981094%27 HTTP/1.1" 200 None
2026-03-24 18:31:07 [ayvens.es] INFO: Scrape type for 1981094: 1
2026-03-24 18:31:07 [ayvens.es] INFO: Extracting data for car ID: 1981094
2026-03-24 18:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1981094
2026-03-24 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d333fac-1d12-579f-8e97-6ce29213f36e with scrape type 1
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6d333fac-1d12-579f-8e97-6ce29213f36e
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252Fa10bbc17391e40f98058c277a8d2f8fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/a10bbc17391e40f98058c277a8d2f8fd/images/large/1.jpg not downloaded yet
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecc9bd0>
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1810c7de-7328-57b8-a689-3ecd7dd45941/1810c7de-7328-57b8-a689-3ecd7dd45941_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F59517c41fdc84bf4acaf45abedf7bbd7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/59517c41fdc84bf4acaf45abedf7bbd7/images/large/1.jpg saved to cache
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1810c7de-7328-57b8-a689-3ecd7dd45941
2026-03-24 18:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1810c7de-7328-57b8-a689-3ecd7dd45941, skipping ID generation
2026-03-24 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1810c7de-7328-57b8-a689-3ecd7dd45941 with scrape type 1
2026-03-24 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1810c7de-7328-57b8-a689-3ecd7dd45941 sending to next pipeline
2026-03-24 18:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1810c7de-7328-57b8-a689-3ecd7dd45941, identifier: 1981086
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee915a50>
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968ce7e3-3804-53d4-af4b-6fb040a356d0/968ce7e3-3804-53d4-af4b-6fb040a356d0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252Fb710121cf13f404686a713c0b4c6bb15%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/b710121cf13f404686a713c0b4c6bb15/images/large/1.jpg saved to cache
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 968ce7e3-3804-53d4-af4b-6fb040a356d0
2026-03-24 18:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 968ce7e3-3804-53d4-af4b-6fb040a356d0, skipping ID generation
2026-03-24 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 968ce7e3-3804-53d4-af4b-6fb040a356d0 with scrape type 1
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 968ce7e3-3804-53d4-af4b-6fb040a356d0 sending to next pipeline
2026-03-24 18:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 968ce7e3-3804-53d4-af4b-6fb040a356d0, identifier: 1981084
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0c3bd0>
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6713a55-41ce-5ab2-9422-56ccbb1db148/f6713a55-41ce-5ab2-9422-56ccbb1db148_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F88e9d2c6c7804cd785cd1f54fe24844f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/88e9d2c6c7804cd785cd1f54fe24844f/images/large/1.jpg saved to cache
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6713a55-41ce-5ab2-9422-56ccbb1db148
2026-03-24 18:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6713a55-41ce-5ab2-9422-56ccbb1db148, skipping ID generation
2026-03-24 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6713a55-41ce-5ab2-9422-56ccbb1db148 with scrape type 1
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6713a55-41ce-5ab2-9422-56ccbb1db148 sending to next pipeline
2026-03-24 18:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6713a55-41ce-5ab2-9422-56ccbb1db148, identifier: 1981085
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee231f10>
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae044edb-102c-58a4-8eea-d0f9b6589450/ae044edb-102c-58a4-8eea-d0f9b6589450_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F633%252F0a7e9c37bbea43aeb04f341f27c9ea53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/633/0a7e9c37bbea43aeb04f341f27c9ea53/images/large/1.jpg saved to cache
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae044edb-102c-58a4-8eea-d0f9b6589450
2026-03-24 18:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae044edb-102c-58a4-8eea-d0f9b6589450, skipping ID generation
2026-03-24 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae044edb-102c-58a4-8eea-d0f9b6589450 with scrape type 1
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae044edb-102c-58a4-8eea-d0f9b6589450 sending to next pipeline
2026-03-24 18:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ae044edb-102c-58a4-8eea-d0f9b6589450, identifier: 1981088
2026-03-24 18:31:08 [ayvens.es] INFO: Found listing with ID: 1981095
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981095%27 HTTP/1.1" 200 None
2026-03-24 18:31:08 [ayvens.es] INFO: Scrape type for 1981095: 1
2026-03-24 18:31:08 [ayvens.es] INFO: Extracting data for car ID: 1981095
2026-03-24 18:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1981095
2026-03-24 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5e1ab8-1493-5c49-a389-502c577143fc with scrape type 1
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c5e1ab8-1493-5c49-a389-502c577143fc
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F5b8b08b982864cdca4c718ee6cbe8cbd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/5b8b08b982864cdca4c718ee6cbe8cbd/images/large/1.jpg not downloaded yet
2026-03-24 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1981086
2026-03-24 18:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1981086
2026-03-24 18:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1981086 to the API
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/948/59517c41fdc84bf4acaf45abedf7bbd7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1810c7de-7328-57b8-a689-3ecd7dd45941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 484567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1810c7de-7328-57b8-a689-3ecd7dd45941/1810c7de-7328-57b8-a689-3ecd7dd45941_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/948/59517c41fdc84bf4acaf45abedf7bbd7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 310 96kW L3H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '310 96kW L3H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981086%27 HTTP/1.1" 200 None
2026-03-24 18:31:08 [ayvens.es] INFO: Saving data for 1981086: {'created_time': 1774377068.858022, 'last_price_update_time': 1774377068.858035, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981086') HTTP/1.1" 204 0
2026-03-24 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 968ce7e3-3804-53d4-af4b-6fb040a356d0 with identifier: 1981084
2026-03-24 18:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 968ce7e3-3804-53d4-af4b-6fb040a356d0 with identifier: 1981084
2026-03-24 18:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 968ce7e3-3804-53d4-af4b-6fb040a356d0 with identifier: 1981084 to the API
2026-03-24 18:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/357/b710121cf13f404686a713c0b4c6bb15/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '968ce7e3-3804-53d4-af4b-6fb040a356d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 114973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968ce7e3-3804-53d4-af4b-6fb040a356d0/968ce7e3-3804-53d4-af4b-6fb040a356d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/357/b710121cf13f404686a713c0b4c6bb15/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon L1H1 Blue dCi 96 Kw (130 CV)',
 'transmission': 'manual',
 'trim': 'Furgon L1H1 Blue dCi 96 Kw (130 CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981084%27 HTTP/1.1" 200 None
2026-03-24 18:31:09 [ayvens.es] INFO: Saving data for 1981084: {'created_time': 1774377069.266728, 'last_price_update_time': 1774377069.26674, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981084') HTTP/1.1" 204 0
2026-03-24 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1981085
2026-03-24 18:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1981085
2026-03-24 18:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1981085 to the API
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/705/88e9d2c6c7804cd785cd1f54fe24844f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6713a55-41ce-5ab2-9422-56ccbb1db148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 142455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6713a55-41ce-5ab2-9422-56ccbb1db148/f6713a55-41ce-5ab2-9422-56ccbb1db148_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/705/88e9d2c6c7804cd785cd1f54fe24844f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981085%27 HTTP/1.1" 200 None
2026-03-24 18:31:09 [ayvens.es] INFO: Saving data for 1981085: {'created_time': 1774377069.574062, 'last_price_update_time': 1774377069.574072, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981085') HTTP/1.1" 204 0
2026-03-24 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1981088
2026-03-24 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1981088
2026-03-24 18:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1981088 to the API
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/633/0a7e9c37bbea43aeb04f341f27c9ea53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Banquise blanco s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ae044edb-102c-58a4-8eea-d0f9b6589450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 108263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae044edb-102c-58a4-8eea-d0f9b6589450/ae044edb-102c-58a4-8eea-d0f9b6589450_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/633/0a7e9c37bbea43aeb04f341f27c9ea53/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 55kW CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 55kW CONTROL',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981088%27 HTTP/1.1" 200 None
2026-03-24 18:31:09 [ayvens.es] INFO: Saving data for 1981088: {'created_time': 1774377069.878066, 'last_price_update_time': 1774377069.878081, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981088') HTTP/1.1" 204 0
2026-03-24 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/700/f86949ff4cd940f9b2ac274cff33e863/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:09 [ayvens.es] INFO: Found listing with ID: 1981096
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981096%27 HTTP/1.1" 200 None
2026-03-24 18:31:09 [ayvens.es] INFO: Scrape type for 1981096: 1
2026-03-24 18:31:09 [ayvens.es] INFO: Extracting data for car ID: 1981096
2026-03-24 18:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1981096
2026-03-24 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfe2d76-f6a3-565e-a22f-481383c85722 with scrape type 1
2026-03-24 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item adfe2d76-f6a3-565e-a22f-481383c85722
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F772%252Fe871d719b8fd423fb993471a4e711107%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/772/e871d719b8fd423fb993471a4e711107/images/large/1.jpg not downloaded yet
2026-03-24 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/474/7ef94db0390f48b08ddfee31fe1b78ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee23e510>
2026-03-24 18:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92126090-b061-51be-8132-b96367b4e951/92126090-b061-51be-8132-b96367b4e951_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F17bc536bb1d34c96990f2a3b87a6c1af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/17bc536bb1d34c96990f2a3b87a6c1af/images/large/1.jpg saved to cache
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92126090-b061-51be-8132-b96367b4e951
2026-03-24 18:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92126090-b061-51be-8132-b96367b4e951, skipping ID generation
2026-03-24 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92126090-b061-51be-8132-b96367b4e951 with scrape type 1
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92126090-b061-51be-8132-b96367b4e951 sending to next pipeline
2026-03-24 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 92126090-b061-51be-8132-b96367b4e951, identifier: 1981087
2026-03-24 18:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/347/6c4aa3ebdec94221aaad5b0a4311b281/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:10 [ayvens.es] INFO: Found listing with ID: 1981097
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981097%27 HTTP/1.1" 200 None
2026-03-24 18:31:10 [ayvens.es] INFO: Scrape type for 1981097: 1
2026-03-24 18:31:10 [ayvens.es] INFO: Extracting data for car ID: 1981097
2026-03-24 18:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4510d8eb-509a-5e4f-984c-79e71f0094a3 with identifier: 1981097
2026-03-24 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4510d8eb-509a-5e4f-984c-79e71f0094a3 with scrape type 1
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4510d8eb-509a-5e4f-984c-79e71f0094a3
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F713%252F6975ba7e77ca4215b82b362673e98627%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/713/6975ba7e77ca4215b82b362673e98627/images/large/1.jpg not downloaded yet
2026-03-24 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 92126090-b061-51be-8132-b96367b4e951 with identifier: 1981087
2026-03-24 18:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 92126090-b061-51be-8132-b96367b4e951 with identifier: 1981087
2026-03-24 18:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 92126090-b061-51be-8132-b96367b4e951 with identifier: 1981087 to the API
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/531/17bc536bb1d34c96990f2a3b87a6c1af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '92126090-b061-51be-8132-b96367b4e951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 239368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92126090-b061-51be-8132-b96367b4e951/92126090-b061-51be-8132-b96367b4e951_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/531/17bc536bb1d34c96990f2a3b87a6c1af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981087%27 HTTP/1.1" 200 None
2026-03-24 18:31:10 [ayvens.es] INFO: Saving data for 1981087: {'created_time': 1774377070.455795, 'last_price_update_time': 1774377070.455805, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981087') HTTP/1.1" 204 0
2026-03-24 18:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/596/c12814d3ed9c4bb8be86521f8f557301/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:10 [ayvens.es] INFO: Found listing with ID: 1981098
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981098%27 HTTP/1.1" 200 None
2026-03-24 18:31:10 [ayvens.es] INFO: Scrape type for 1981098: 1
2026-03-24 18:31:10 [ayvens.es] INFO: Extracting data for car ID: 1981098
2026-03-24 18:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1981098
2026-03-24 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d262aff6-2d29-592c-966c-8acfdbf103b9 with scrape type 1
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d262aff6-2d29-592c-966c-8acfdbf103b9
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F056c1e5ab8014bf399ad4a7fbd753e46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/056c1e5ab8014bf399ad4a7fbd753e46/images/large/1.jpg not downloaded yet
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea33950>
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb948f05-429d-566e-a6ae-d60c9276b615/bb948f05-429d-566e-a6ae-d60c9276b615_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F700%252Ff86949ff4cd940f9b2ac274cff33e863%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/700/f86949ff4cd940f9b2ac274cff33e863/images/large/1.jpg saved to cache
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb948f05-429d-566e-a6ae-d60c9276b615
2026-03-24 18:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb948f05-429d-566e-a6ae-d60c9276b615, skipping ID generation
2026-03-24 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb948f05-429d-566e-a6ae-d60c9276b615 with scrape type 1
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb948f05-429d-566e-a6ae-d60c9276b615 sending to next pipeline
2026-03-24 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb948f05-429d-566e-a6ae-d60c9276b615, identifier: 1981090
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee947c10>
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8af016-8aef-5cb2-8887-0444d747e2c9/9f8af016-8aef-5cb2-8887-0444d747e2c9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F7ef94db0390f48b08ddfee31fe1b78ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/7ef94db0390f48b08ddfee31fe1b78ac/images/large/1.jpg saved to cache
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f8af016-8aef-5cb2-8887-0444d747e2c9
2026-03-24 18:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f8af016-8aef-5cb2-8887-0444d747e2c9, skipping ID generation
2026-03-24 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8af016-8aef-5cb2-8887-0444d747e2c9 with scrape type 1
2026-03-24 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f8af016-8aef-5cb2-8887-0444d747e2c9 sending to next pipeline
2026-03-24 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9f8af016-8aef-5cb2-8887-0444d747e2c9, identifier: 1981091
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee820cd0>
2026-03-24 18:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ce51ee-f381-58d9-8c17-80175aa29e82/67ce51ee-f381-58d9-8c17-80175aa29e82_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F347%252F6c4aa3ebdec94221aaad5b0a4311b281%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/347/6c4aa3ebdec94221aaad5b0a4311b281/images/large/1.jpg saved to cache
2026-03-24 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67ce51ee-f381-58d9-8c17-80175aa29e82
2026-03-24 18:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67ce51ee-f381-58d9-8c17-80175aa29e82, skipping ID generation
2026-03-24 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ce51ee-f381-58d9-8c17-80175aa29e82 with scrape type 1
2026-03-24 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67ce51ee-f381-58d9-8c17-80175aa29e82 sending to next pipeline
2026-03-24 18:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 67ce51ee-f381-58d9-8c17-80175aa29e82, identifier: 1981089
2026-03-24 18:31:11 [ayvens.es] INFO: Found listing with ID: 1981099
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981099%27 HTTP/1.1" 200 None
2026-03-24 18:31:11 [ayvens.es] INFO: Scrape type for 1981099: 1
2026-03-24 18:31:11 [ayvens.es] INFO: Extracting data for car ID: 1981099
2026-03-24 18:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81d9d18e-c114-51be-a699-9cfd704dac5e with identifier: 1981099
2026-03-24 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81d9d18e-c114-51be-a699-9cfd704dac5e with scrape type 1
2026-03-24 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81d9d18e-c114-51be-a699-9cfd704dac5e
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F889%252F77ef48372090401f834cc6decf1751a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/889/77ef48372090401f834cc6decf1751a6/images/large/1.jpg not downloaded yet
2026-03-24 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb948f05-429d-566e-a6ae-d60c9276b615 with identifier: 1981090
2026-03-24 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb948f05-429d-566e-a6ae-d60c9276b615 with identifier: 1981090
2026-03-24 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb948f05-429d-566e-a6ae-d60c9276b615 with identifier: 1981090 to the API
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/700/f86949ff4cd940f9b2ac274cff33e863/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb948f05-429d-566e-a6ae-d60c9276b615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 112833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb948f05-429d-566e-a6ae-d60c9276b615/bb948f05-429d-566e-a6ae-d60c9276b615_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/700/f86949ff4cd940f9b2ac274cff33e863/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981090%27 HTTP/1.1" 200 None
2026-03-24 18:31:11 [ayvens.es] INFO: Saving data for 1981090: {'created_time': 1774377071.472418, 'last_price_update_time': 1774377071.472428, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981090') HTTP/1.1" 204 0
2026-03-24 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1981091
2026-03-24 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1981091
2026-03-24 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1981091 to the API
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/474/7ef94db0390f48b08ddfee31fe1b78ac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco banquise s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9f8af016-8aef-5cb2-8887-0444d747e2c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 58482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8af016-8aef-5cb2-8887-0444d747e2c9/9f8af016-8aef-5cb2-8887-0444d747e2c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/474/7ef94db0390f48b08ddfee31fe1b78ac/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981091%27 HTTP/1.1" 200 None
2026-03-24 18:31:11 [ayvens.es] INFO: Saving data for 1981091: {'created_time': 1774377071.846476, 'last_price_update_time': 1774377071.846488, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981091') HTTP/1.1" 204 0
2026-03-24 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 67ce51ee-f381-58d9-8c17-80175aa29e82 with identifier: 1981089
2026-03-24 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 67ce51ee-f381-58d9-8c17-80175aa29e82 with identifier: 1981089
2026-03-24 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 67ce51ee-f381-58d9-8c17-80175aa29e82 with identifier: 1981089 to the API
2026-03-24 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/347/6c4aa3ebdec94221aaad5b0a4311b281/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '67ce51ee-f381-58d9-8c17-80175aa29e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 188588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ce51ee-f381-58d9-8c17-80175aa29e82/67ce51ee-f381-58d9-8c17-80175aa29e82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/347/6c4aa3ebdec94221aaad5b0a4311b281/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981089%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [ayvens.es] INFO: Saving data for 1981089: {'created_time': 1774377072.12383, 'last_price_update_time': 1774377072.123841, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981089') HTTP/1.1" 204 0
2026-03-24 18:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/107/a10bbc17391e40f98058c277a8d2f8fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:12 [ayvens.es] INFO: Found listing with ID: 1981100
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981100%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [ayvens.es] INFO: Scrape type for 1981100: 1
2026-03-24 18:31:12 [ayvens.es] INFO: Extracting data for car ID: 1981100
2026-03-24 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1981100
2026-03-24 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2a44db-6e0c-5028-a867-1513e003a3a5 with scrape type 1
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb2a44db-6e0c-5028-a867-1513e003a3a5
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Fbd3bd8bb544f4d3d8f365da9e336d18a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/bd3bd8bb544f4d3d8f365da9e336d18a/images/large/1.jpg not downloaded yet
2026-03-24 18:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/303/2f815d5577d34af587d68c9d8c162d01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea14250>
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa528d81-9e42-55a9-bae0-13e92ec2a953/aa528d81-9e42-55a9-bae0-13e92ec2a953_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252Fc12814d3ed9c4bb8be86521f8f557301%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/c12814d3ed9c4bb8be86521f8f557301/images/large/1.jpg saved to cache
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa528d81-9e42-55a9-bae0-13e92ec2a953
2026-03-24 18:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa528d81-9e42-55a9-bae0-13e92ec2a953, skipping ID generation
2026-03-24 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa528d81-9e42-55a9-bae0-13e92ec2a953 with scrape type 1
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa528d81-9e42-55a9-bae0-13e92ec2a953 sending to next pipeline
2026-03-24 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aa528d81-9e42-55a9-bae0-13e92ec2a953, identifier: 1981092
2026-03-24 18:31:12 [ayvens.es] INFO: Found listing with ID: 1981101
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981101%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [ayvens.es] INFO: Scrape type for 1981101: 1
2026-03-24 18:31:12 [ayvens.es] INFO: Extracting data for car ID: 1981101
2026-03-24 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1981101
2026-03-24 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ce036c-ba84-5f72-9300-0f0af027e100 with scrape type 1
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c7ce036c-ba84-5f72-9300-0f0af027e100
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Fc5c6781f109a401d8ddb60e4acfdad22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/c5c6781f109a401d8ddb60e4acfdad22/images/large/1.jpg not downloaded yet
2026-03-24 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aa528d81-9e42-55a9-bae0-13e92ec2a953 with identifier: 1981092
2026-03-24 18:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aa528d81-9e42-55a9-bae0-13e92ec2a953 with identifier: 1981092
2026-03-24 18:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aa528d81-9e42-55a9-bae0-13e92ec2a953 with identifier: 1981092 to the API
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/596/c12814d3ed9c4bb8be86521f8f557301/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aa528d81-9e42-55a9-bae0-13e92ec2a953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 144337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa528d81-9e42-55a9-bae0-13e92ec2a953/aa528d81-9e42-55a9-bae0-13e92ec2a953_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/596/c12814d3ed9c4bb8be86521f8f557301/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Pro 1.5 BlueHDi 120 S&S Standard',
 'transmission': 'manual',
 'trim': 'Furgon Pro 1.5 BlueHDi 120 S&S Standard',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981092%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [ayvens.es] INFO: Saving data for 1981092: {'created_time': 1774377072.757177, 'last_price_update_time': 1774377072.757186, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981092') HTTP/1.1" 204 0
2026-03-24 18:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/772/e871d719b8fd423fb993471a4e711107/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:12 [ayvens.es] INFO: Found listing with ID: 1981102
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981102%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [ayvens.es] INFO: Scrape type for 1981102: 1
2026-03-24 18:31:12 [ayvens.es] INFO: Extracting data for car ID: 1981102
2026-03-24 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f97dee-ec50-5591-b4b0-9af5d4dfbc59 with identifier: 1981102
2026-03-24 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f97dee-ec50-5591-b4b0-9af5d4dfbc59 with scrape type 1
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17f97dee-ec50-5591-b4b0-9af5d4dfbc59
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F086%252Fbe6ef2fcef5743aeb209b7603066f2a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/086/be6ef2fcef5743aeb209b7603066f2a7/images/large/1.jpg not downloaded yet
2026-03-24 18:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/135/5b8b08b982864cdca4c718ee6cbe8cbd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0982550>
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d333fac-1d12-579f-8e97-6ce29213f36e/6d333fac-1d12-579f-8e97-6ce29213f36e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252Fa10bbc17391e40f98058c277a8d2f8fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/a10bbc17391e40f98058c277a8d2f8fd/images/large/1.jpg saved to cache
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d333fac-1d12-579f-8e97-6ce29213f36e
2026-03-24 18:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d333fac-1d12-579f-8e97-6ce29213f36e, skipping ID generation
2026-03-24 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d333fac-1d12-579f-8e97-6ce29213f36e with scrape type 1
2026-03-24 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d333fac-1d12-579f-8e97-6ce29213f36e sending to next pipeline
2026-03-24 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6d333fac-1d12-579f-8e97-6ce29213f36e, identifier: 1981094
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee250290>
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8/3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252F2f815d5577d34af587d68c9d8c162d01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/2f815d5577d34af587d68c9d8c162d01/images/large/1.jpg saved to cache
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8
2026-03-24 18:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8, skipping ID generation
2026-03-24 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with scrape type 1
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 sending to next pipeline
2026-03-24 18:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8, identifier: 1981093
2026-03-24 18:31:13 [ayvens.es] INFO: Found listing with ID: 1981103
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981103%27 HTTP/1.1" 200 None
2026-03-24 18:31:13 [ayvens.es] INFO: Scrape type for 1981103: 1
2026-03-24 18:31:13 [ayvens.es] INFO: Extracting data for car ID: 1981103
2026-03-24 18:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1981103
2026-03-24 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5447e8a-9776-57ef-9a3c-6a6a6587144b with scrape type 1
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5447e8a-9776-57ef-9a3c-6a6a6587144b
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252F36e626e4044045928554aefe598f0ff9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/36e626e4044045928554aefe598f0ff9/images/large/1.jpg not downloaded yet
2026-03-24 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1981094
2026-03-24 18:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1981094
2026-03-24 18:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1981094 to the API
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/107/a10bbc17391e40f98058c277a8d2f8fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6d333fac-1d12-579f-8e97-6ce29213f36e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 189427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d333fac-1d12-579f-8e97-6ce29213f36e/6d333fac-1d12-579f-8e97-6ce29213f36e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/107/a10bbc17391e40f98058c277a8d2f8fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'transmission': 'manual',
 'trim': '2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981094%27 HTTP/1.1" 200 None
2026-03-24 18:31:13 [ayvens.es] INFO: Saving data for 1981094: {'created_time': 1774377073.466423, 'last_price_update_time': 1774377073.466434, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981094') HTTP/1.1" 204 0
2026-03-24 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1981093
2026-03-24 18:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1981093
2026-03-24 18:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1981093 to the API
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/303/2f815d5577d34af587d68c9d8c162d01/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 286296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8/3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/303/2f815d5577d34af587d68c9d8c162d01/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981093%27 HTTP/1.1" 200 None
2026-03-24 18:31:13 [ayvens.es] INFO: Saving data for 1981093: {'created_time': 1774377073.794177, 'last_price_update_time': 1774377073.794188, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981093') HTTP/1.1" 204 0
2026-03-24 18:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/713/6975ba7e77ca4215b82b362673e98627/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:13 [ayvens.es] INFO: Found listing with ID: 1981104
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981104%27 HTTP/1.1" 200 None
2026-03-24 18:31:13 [ayvens.es] INFO: Scrape type for 1981104: 1
2026-03-24 18:31:13 [ayvens.es] INFO: Extracting data for car ID: 1981104
2026-03-24 18:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1981104
2026-03-24 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662e1622-3572-5b4d-a914-813caf4b4e35 with scrape type 1
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 662e1622-3572-5b4d-a914-813caf4b4e35
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F57db09b8bc91470e9bfd68587b89020b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/57db09b8bc91470e9bfd68587b89020b/images/large/1.jpg not downloaded yet
2026-03-24 18:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/826/056c1e5ab8014bf399ad4a7fbd753e46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0600290>
2026-03-24 18:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adfe2d76-f6a3-565e-a22f-481383c85722/adfe2d76-f6a3-565e-a22f-481383c85722_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F772%252Fe871d719b8fd423fb993471a4e711107%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/772/e871d719b8fd423fb993471a4e711107/images/large/1.jpg saved to cache
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adfe2d76-f6a3-565e-a22f-481383c85722
2026-03-24 18:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adfe2d76-f6a3-565e-a22f-481383c85722, skipping ID generation
2026-03-24 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfe2d76-f6a3-565e-a22f-481383c85722 with scrape type 1
2026-03-24 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adfe2d76-f6a3-565e-a22f-481383c85722 sending to next pipeline
2026-03-24 18:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: adfe2d76-f6a3-565e-a22f-481383c85722, identifier: 1981096
2026-03-24 18:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0c6ff90>
2026-03-24 18:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c5e1ab8-1493-5c49-a389-502c577143fc/1c5e1ab8-1493-5c49-a389-502c577143fc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F5b8b08b982864cdca4c718ee6cbe8cbd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/5b8b08b982864cdca4c718ee6cbe8cbd/images/large/1.jpg saved to cache
2026-03-24 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c5e1ab8-1493-5c49-a389-502c577143fc
2026-03-24 18:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c5e1ab8-1493-5c49-a389-502c577143fc, skipping ID generation
2026-03-24 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5e1ab8-1493-5c49-a389-502c577143fc with scrape type 1
2026-03-24 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c5e1ab8-1493-5c49-a389-502c577143fc sending to next pipeline
2026-03-24 18:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1c5e1ab8-1493-5c49-a389-502c577143fc, identifier: 1981095
2026-03-24 18:31:14 [ayvens.es] INFO: Found listing with ID: 1981105
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981105%27 HTTP/1.1" 200 None
2026-03-24 18:31:14 [ayvens.es] INFO: Scrape type for 1981105: 1
2026-03-24 18:31:14 [ayvens.es] INFO: Extracting data for car ID: 1981105
2026-03-24 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1981105
2026-03-24 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0adba50b-99a8-577a-b615-98ef67d70604 with scrape type 1
2026-03-24 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0adba50b-99a8-577a-b615-98ef67d70604
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252Ff3723f6e1a214fe2afc8f5a53cec7d69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/f3723f6e1a214fe2afc8f5a53cec7d69/images/large/1.jpg not downloaded yet
2026-03-24 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1981096
2026-03-24 18:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1981096
2026-03-24 18:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1981096 to the API
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/772/e871d719b8fd423fb993471a4e711107/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'adfe2d76-f6a3-565e-a22f-481383c85722',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 222133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adfe2d76-f6a3-565e-a22f-481383c85722/adfe2d76-f6a3-565e-a22f-481383c85722_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/772/e871d719b8fd423fb993471a4e711107/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA Dob. Cab. 2.3dCi EU6 120kW(160CV) Acenta',
 'transmission': 'manual',
 'trim': 'Dob. Cab. 2.3dCi EU6 120kW(160CV) Acenta',
 'vin': None,
 'year': 2018}
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981096%27 HTTP/1.1" 200 None
2026-03-24 18:31:14 [ayvens.es] INFO: Saving data for 1981096: {'created_time': 1774377074.536684, 'last_price_update_time': 1774377074.536697, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981096') HTTP/1.1" 204 0
2026-03-24 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1981095
2026-03-24 18:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1981095
2026-03-24 18:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1981095 to the API
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/135/5b8b08b982864cdca4c718ee6cbe8cbd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 276,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1c5e1ab8-1493-5c49-a389-502c577143fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NT400 CABSTAR',
 'odometer': 82048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c5e1ab8-1493-5c49-a389-502c577143fc/1c5e1ab8-1493-5c49-a389-502c577143fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/135/5b8b08b982864cdca4c718ee6cbe8cbd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NT400 CABSTAR 45.15/3 Premium Cab Abatible Larga',
 'transmission': 'manual',
 'trim': '45.15/3 Premium Cab Abatible Larga',
 'vin': None,
 'year': 2018}
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981095%27 HTTP/1.1" 200 None
2026-03-24 18:31:14 [ayvens.es] INFO: Saving data for 1981095: {'created_time': 1774377074.938476, 'last_price_update_time': 1774377074.938487, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981095') HTTP/1.1" 204 0
2026-03-24 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/024/bd3bd8bb544f4d3d8f365da9e336d18a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/889/77ef48372090401f834cc6decf1751a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:14 [ayvens.es] INFO: Found listing with ID: 1981106
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981106%27 HTTP/1.1" 200 None
2026-03-24 18:31:14 [ayvens.es] INFO: Scrape type for 1981106: 1
2026-03-24 18:31:14 [ayvens.es] INFO: Extracting data for car ID: 1981106
2026-03-24 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fbe0678-1b4f-528a-b1b7-776e309e7a9d with identifier: 1981106
2026-03-24 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbe0678-1b4f-528a-b1b7-776e309e7a9d with scrape type 1
2026-03-24 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1fbe0678-1b4f-528a-b1b7-776e309e7a9d
2026-03-24 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F14c9f14956624f1db932e617fc3b9c9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/14c9f14956624f1db932e617fc3b9c9c/images/large/1.jpg not downloaded yet
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f09ab450>
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4510d8eb-509a-5e4f-984c-79e71f0094a3/4510d8eb-509a-5e4f-984c-79e71f0094a3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F713%252F6975ba7e77ca4215b82b362673e98627%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/713/6975ba7e77ca4215b82b362673e98627/images/large/1.jpg saved to cache
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4510d8eb-509a-5e4f-984c-79e71f0094a3
2026-03-24 18:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4510d8eb-509a-5e4f-984c-79e71f0094a3, skipping ID generation
2026-03-24 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4510d8eb-509a-5e4f-984c-79e71f0094a3 with scrape type 1
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4510d8eb-509a-5e4f-984c-79e71f0094a3 sending to next pipeline
2026-03-24 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4510d8eb-509a-5e4f-984c-79e71f0094a3, identifier: 1981097
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7f9b90>
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d262aff6-2d29-592c-966c-8acfdbf103b9/d262aff6-2d29-592c-966c-8acfdbf103b9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F056c1e5ab8014bf399ad4a7fbd753e46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/056c1e5ab8014bf399ad4a7fbd753e46/images/large/1.jpg saved to cache
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d262aff6-2d29-592c-966c-8acfdbf103b9
2026-03-24 18:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d262aff6-2d29-592c-966c-8acfdbf103b9, skipping ID generation
2026-03-24 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d262aff6-2d29-592c-966c-8acfdbf103b9 with scrape type 1
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d262aff6-2d29-592c-966c-8acfdbf103b9 sending to next pipeline
2026-03-24 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d262aff6-2d29-592c-966c-8acfdbf103b9, identifier: 1981098
2026-03-24 18:31:15 [ayvens.es] INFO: Found listing with ID: 1981107
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981107%27 HTTP/1.1" 200 None
2026-03-24 18:31:15 [ayvens.es] INFO: Scrape type for 1981107: 1
2026-03-24 18:31:15 [ayvens.es] INFO: Extracting data for car ID: 1981107
2026-03-24 18:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ea1796-cbb0-53f9-a37b-7af4ea4c215b with identifier: 1981107
2026-03-24 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ea1796-cbb0-53f9-a37b-7af4ea4c215b with scrape type 1
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f5ea1796-cbb0-53f9-a37b-7af4ea4c215b
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F988%252Ff779d9c50b544935bbe250f2df04e633%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/988/f779d9c50b544935bbe250f2df04e633/images/large/1.jpg not downloaded yet
2026-03-24 18:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4510d8eb-509a-5e4f-984c-79e71f0094a3 with identifier: 1981097
2026-03-24 18:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4510d8eb-509a-5e4f-984c-79e71f0094a3 with identifier: 1981097
2026-03-24 18:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4510d8eb-509a-5e4f-984c-79e71f0094a3 with identifier: 1981097 to the API
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/713/6975ba7e77ca4215b82b362673e98627/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4510d8eb-509a-5e4f-984c-79e71f0094a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 141981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4510d8eb-509a-5e4f-984c-79e71f0094a3/4510d8eb-509a-5e4f-984c-79e71f0094a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/713/6975ba7e77ca4215b82b362673e98627/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'transmission': 'manual',
 'trim': 'D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981097%27 HTTP/1.1" 200 None
2026-03-24 18:31:15 [ayvens.es] INFO: Saving data for 1981097: {'created_time': 1774377075.660361, 'last_price_update_time': 1774377075.660371, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981097') HTTP/1.1" 204 0
2026-03-24 18:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1981098
2026-03-24 18:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1981098
2026-03-24 18:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1981098 to the API
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/826/056c1e5ab8014bf399ad4a7fbd753e46/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd262aff6-2d29-592c-966c-8acfdbf103b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 39417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d262aff6-2d29-592c-966c-8acfdbf103b9/d262aff6-2d29-592c-966c-8acfdbf103b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/826/056c1e5ab8014bf399ad4a7fbd753e46/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX+++Revisar peritacion+++',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981098%27 HTTP/1.1" 200 None
2026-03-24 18:31:15 [ayvens.es] INFO: Saving data for 1981098: {'created_time': 1774377075.984708, 'last_price_update_time': 1774377075.984718, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981098') HTTP/1.1" 204 0
2026-03-24 18:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/086/be6ef2fcef5743aeb209b7603066f2a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:16 [ayvens.es] INFO: Found listing with ID: 1981108
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981108%27 HTTP/1.1" 200 None
2026-03-24 18:31:16 [ayvens.es] INFO: Scrape type for 1981108: 1
2026-03-24 18:31:16 [ayvens.es] INFO: Extracting data for car ID: 1981108
2026-03-24 18:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c5533f-ff6b-51ae-9b31-5b317912ad56 with identifier: 1981108
2026-03-24 18:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c5533f-ff6b-51ae-9b31-5b317912ad56 with scrape type 1
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83c5533f-ff6b-51ae-9b31-5b317912ad56
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F8d046339f1554c81b38307fdcf6f8317%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/8d046339f1554c81b38307fdcf6f8317/images/large/1.jpg not downloaded yet
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee23f810>
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2a44db-6e0c-5028-a867-1513e003a3a5/bb2a44db-6e0c-5028-a867-1513e003a3a5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Fbd3bd8bb544f4d3d8f365da9e336d18a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/bd3bd8bb544f4d3d8f365da9e336d18a/images/large/1.jpg saved to cache
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb2a44db-6e0c-5028-a867-1513e003a3a5
2026-03-24 18:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb2a44db-6e0c-5028-a867-1513e003a3a5, skipping ID generation
2026-03-24 18:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2a44db-6e0c-5028-a867-1513e003a3a5 with scrape type 1
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb2a44db-6e0c-5028-a867-1513e003a3a5 sending to next pipeline
2026-03-24 18:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb2a44db-6e0c-5028-a867-1513e003a3a5, identifier: 1981100
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee975850>
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d9d18e-c114-51be-a699-9cfd704dac5e/81d9d18e-c114-51be-a699-9cfd704dac5e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F889%252F77ef48372090401f834cc6decf1751a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/889/77ef48372090401f834cc6decf1751a6/images/large/1.jpg saved to cache
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81d9d18e-c114-51be-a699-9cfd704dac5e
2026-03-24 18:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81d9d18e-c114-51be-a699-9cfd704dac5e, skipping ID generation
2026-03-24 18:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81d9d18e-c114-51be-a699-9cfd704dac5e with scrape type 1
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81d9d18e-c114-51be-a699-9cfd704dac5e sending to next pipeline
2026-03-24 18:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 81d9d18e-c114-51be-a699-9cfd704dac5e, identifier: 1981099
2026-03-24 18:31:16 [ayvens.es] INFO: Found listing with ID: 1981109
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981109%27 HTTP/1.1" 200 None
2026-03-24 18:31:16 [ayvens.es] INFO: Scrape type for 1981109: 1
2026-03-24 18:31:16 [ayvens.es] INFO: Extracting data for car ID: 1981109
2026-03-24 18:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1981109
2026-03-24 18:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916d34c5-301c-5fdf-988e-607779018868 with scrape type 1
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 916d34c5-301c-5fdf-988e-607779018868
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Fa4f7d018182d4e4496e1f35831d2d646%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/a4f7d018182d4e4496e1f35831d2d646/images/large/1.jpg not downloaded yet
2026-03-24 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1981100
2026-03-24 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1981100
2026-03-24 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1981100 to the API
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/024/bd3bd8bb544f4d3d8f365da9e336d18a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.4L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb2a44db-6e0c-5028-a867-1513e003a3a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 59367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2a44db-6e0c-5028-a867-1513e003a3a5/bb2a44db-6e0c-5028-a867-1513e003a3a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/bd3bd8bb544f4d3d8f365da9e336d18a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Sencilla GX+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Sencilla GX+++Revisar peritacion+++',
 'vin': None,
 'year': 2018}
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981100%27 HTTP/1.1" 200 None
2026-03-24 18:31:16 [ayvens.es] INFO: Saving data for 1981100: {'created_time': 1774377076.704731, 'last_price_update_time': 1774377076.704744, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981100') HTTP/1.1" 204 0
2026-03-24 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 81d9d18e-c114-51be-a699-9cfd704dac5e with identifier: 1981099
2026-03-24 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 81d9d18e-c114-51be-a699-9cfd704dac5e with identifier: 1981099
2026-03-24 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 81d9d18e-c114-51be-a699-9cfd704dac5e with identifier: 1981099 to the API
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/889/77ef48372090401f834cc6decf1751a6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'color': 'Glaciar blanco opaca',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '81d9d18e-c114-51be-a699-9cfd704dac5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 322553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d9d18e-c114-51be-a699-9cfd704dac5e/81d9d18e-c114-51be-a699-9cfd704dac5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/889/77ef48372090401f834cc6decf1751a6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Bl dCi 100kW (135CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Bl dCi 100kW (135CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981099%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [ayvens.es] INFO: Saving data for 1981099: {'created_time': 1774377077.051705, 'last_price_update_time': 1774377077.051715, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981099') HTTP/1.1" 204 0
2026-03-24 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/849/57db09b8bc91470e9bfd68587b89020b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/940/c5c6781f109a401d8ddb60e4acfdad22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:17 [ayvens.es] INFO: Found listing with ID: 1981110
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981110%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [ayvens.es] INFO: Scrape type for 1981110: 1
2026-03-24 18:31:17 [ayvens.es] INFO: Extracting data for car ID: 1981110
2026-03-24 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aecbf63-f76f-5a76-918d-1e2f93aaec7c with identifier: 1981110
2026-03-24 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aecbf63-f76f-5a76-918d-1e2f93aaec7c with scrape type 1
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1aecbf63-f76f-5a76-918d-1e2f93aaec7c
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252F1cf5cdf773694f869fdb675219e71022%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/1cf5cdf773694f869fdb675219e71022/images/large/1.jpg not downloaded yet
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee976e90>
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f97dee-ec50-5591-b4b0-9af5d4dfbc59/17f97dee-ec50-5591-b4b0-9af5d4dfbc59_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F086%252Fbe6ef2fcef5743aeb209b7603066f2a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/086/be6ef2fcef5743aeb209b7603066f2a7/images/large/1.jpg saved to cache
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17f97dee-ec50-5591-b4b0-9af5d4dfbc59
2026-03-24 18:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17f97dee-ec50-5591-b4b0-9af5d4dfbc59, skipping ID generation
2026-03-24 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f97dee-ec50-5591-b4b0-9af5d4dfbc59 with scrape type 1
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17f97dee-ec50-5591-b4b0-9af5d4dfbc59 sending to next pipeline
2026-03-24 18:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 17f97dee-ec50-5591-b4b0-9af5d4dfbc59, identifier: 1981102
2026-03-24 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/317/36e626e4044045928554aefe598f0ff9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:17 [ayvens.es] INFO: Found listing with ID: 1981111
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981111%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [ayvens.es] INFO: Scrape type for 1981111: 1
2026-03-24 18:31:17 [ayvens.es] INFO: Extracting data for car ID: 1981111
2026-03-24 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1981111
2026-03-24 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with scrape type 1
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F539%252F889d04c1bf3e4a32801b74b96e8b7a11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/539/889d04c1bf3e4a32801b74b96e8b7a11/images/large/1.jpg not downloaded yet
2026-03-24 18:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 17f97dee-ec50-5591-b4b0-9af5d4dfbc59 with identifier: 1981102
2026-03-24 18:31:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 17f97dee-ec50-5591-b4b0-9af5d4dfbc59 with identifier: 1981102
2026-03-24 18:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 17f97dee-ec50-5591-b4b0-9af5d4dfbc59 with identifier: 1981102 to the API
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/086/be6ef2fcef5743aeb209b7603066f2a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '17f97dee-ec50-5591-b4b0-9af5d4dfbc59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 252693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f97dee-ec50-5591-b4b0-9af5d4dfbc59/17f97dee-ec50-5591-b4b0-9af5d4dfbc59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/086/be6ef2fcef5743aeb209b7603066f2a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981102%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [ayvens.es] INFO: Saving data for 1981102: {'created_time': 1774377077.793173, 'last_price_update_time': 1774377077.793183, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981102') HTTP/1.1" 204 0
2026-03-24 18:31:17 [ayvens.es] INFO: Found listing with ID: 1981112
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981112%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [ayvens.es] INFO: Scrape type for 1981112: 1
2026-03-24 18:31:17 [ayvens.es] INFO: Extracting data for car ID: 1981112
2026-03-24 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1981112
2026-03-24 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9287a3d-df00-529b-8e81-12c212ce4ae0 with scrape type 1
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9287a3d-df00-529b-8e81-12c212ce4ae0
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F625%252F88dee50f3b4c4d5ebf3eff78c7228f4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/625/88dee50f3b4c4d5ebf3eff78c7228f4c/images/large/1.jpg not downloaded yet
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee2247d0>
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_662e1622-3572-5b4d-a914-813caf4b4e35/662e1622-3572-5b4d-a914-813caf4b4e35_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F57db09b8bc91470e9bfd68587b89020b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/57db09b8bc91470e9bfd68587b89020b/images/large/1.jpg saved to cache
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 662e1622-3572-5b4d-a914-813caf4b4e35
2026-03-24 18:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 662e1622-3572-5b4d-a914-813caf4b4e35, skipping ID generation
2026-03-24 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662e1622-3572-5b4d-a914-813caf4b4e35 with scrape type 1
2026-03-24 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 662e1622-3572-5b4d-a914-813caf4b4e35 sending to next pipeline
2026-03-24 18:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 662e1622-3572-5b4d-a914-813caf4b4e35, identifier: 1981104
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7ceed0>
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ce036c-ba84-5f72-9300-0f0af027e100/c7ce036c-ba84-5f72-9300-0f0af027e100_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Fc5c6781f109a401d8ddb60e4acfdad22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/c5c6781f109a401d8ddb60e4acfdad22/images/large/1.jpg saved to cache
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7ce036c-ba84-5f72-9300-0f0af027e100
2026-03-24 18:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7ce036c-ba84-5f72-9300-0f0af027e100, skipping ID generation
2026-03-24 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ce036c-ba84-5f72-9300-0f0af027e100 with scrape type 1
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7ce036c-ba84-5f72-9300-0f0af027e100 sending to next pipeline
2026-03-24 18:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c7ce036c-ba84-5f72-9300-0f0af027e100, identifier: 1981101
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a8f10>
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5447e8a-9776-57ef-9a3c-6a6a6587144b/b5447e8a-9776-57ef-9a3c-6a6a6587144b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252F36e626e4044045928554aefe598f0ff9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/36e626e4044045928554aefe598f0ff9/images/large/1.jpg saved to cache
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5447e8a-9776-57ef-9a3c-6a6a6587144b
2026-03-24 18:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5447e8a-9776-57ef-9a3c-6a6a6587144b, skipping ID generation
2026-03-24 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5447e8a-9776-57ef-9a3c-6a6a6587144b with scrape type 1
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5447e8a-9776-57ef-9a3c-6a6a6587144b sending to next pipeline
2026-03-24 18:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5447e8a-9776-57ef-9a3c-6a6a6587144b, identifier: 1981103
2026-03-24 18:31:18 [ayvens.es] INFO: Found listing with ID: 1981113
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981113%27 HTTP/1.1" 200 None
2026-03-24 18:31:18 [ayvens.es] INFO: Scrape type for 1981113: 1
2026-03-24 18:31:18 [ayvens.es] INFO: Extracting data for car ID: 1981113
2026-03-24 18:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1981113
2026-03-24 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0c835f-93e2-5056-a03c-a73ca90875df with scrape type 1
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9f0c835f-93e2-5056-a03c-a73ca90875df
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F825%252Fa3d156f6680a454090626e7b02baf042%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/825/a3d156f6680a454090626e7b02baf042/images/large/1.jpg not downloaded yet
2026-03-24 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1981104
2026-03-24 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1981104
2026-03-24 18:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1981104 to the API
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/849/57db09b8bc91470e9bfd68587b89020b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'gas',
 'id': '662e1622-3572-5b4d-a914-813caf4b4e35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 179229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_662e1622-3572-5b4d-a914-813caf4b4e35/662e1622-3572-5b4d-a914-813caf4b4e35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/849/57db09b8bc91470e9bfd68587b89020b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (107CV) GLP+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (107CV) GLP+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981104%27 HTTP/1.1" 200 None
2026-03-24 18:31:18 [ayvens.es] INFO: Saving data for 1981104: {'created_time': 1774377078.651077, 'last_price_update_time': 1774377078.651087, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981104') HTTP/1.1" 204 0
2026-03-24 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1981101
2026-03-24 18:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1981101
2026-03-24 18:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1981101 to the API
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/940/c5c6781f109a401d8ddb60e4acfdad22/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c7ce036c-ba84-5f72-9300-0f0af027e100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 247225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ce036c-ba84-5f72-9300-0f0af027e100/c7ce036c-ba84-5f72-9300-0f0af027e100_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/940/c5c6781f109a401d8ddb60e4acfdad22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981101%27 HTTP/1.1" 200 None
2026-03-24 18:31:18 [ayvens.es] INFO: Saving data for 1981101: {'created_time': 1774377078.989779, 'last_price_update_time': 1774377078.989792, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981101') HTTP/1.1" 204 0
2026-03-24 18:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1981103
2026-03-24 18:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1981103
2026-03-24 18:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1981103 to the API
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/317/36e626e4044045928554aefe598f0ff9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5447e8a-9776-57ef-9a3c-6a6a6587144b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 270286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5447e8a-9776-57ef-9a3c-6a6a6587144b/b5447e8a-9776-57ef-9a3c-6a6a6587144b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/317/36e626e4044045928554aefe598f0ff9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981103%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [ayvens.es] INFO: Saving data for 1981103: {'created_time': 1774377079.313743, 'last_price_update_time': 1774377079.313753, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981103') HTTP/1.1" 204 0
2026-03-24 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/135/14c9f14956624f1db932e617fc3b9c9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/860/f3723f6e1a214fe2afc8f5a53cec7d69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/108/8d046339f1554c81b38307fdcf6f8317/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:19 [ayvens.es] INFO: Found listing with ID: 1981114
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981114%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [ayvens.es] INFO: Scrape type for 1981114: 1
2026-03-24 18:31:19 [ayvens.es] INFO: Extracting data for car ID: 1981114
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1981114
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce336c03-2f79-5688-998e-bad45e5068c8 with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce336c03-2f79-5688-998e-bad45e5068c8
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252Fe8e1c64c94154b31a827c3fd75c32131%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/e8e1c64c94154b31a827c3fd75c32131/images/large/1.jpg not downloaded yet
2026-03-24 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/988/f779d9c50b544935bbe250f2df04e633/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:19 [ayvens.es] INFO: Found listing with ID: 1981115
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981115%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [ayvens.es] INFO: Scrape type for 1981115: 1
2026-03-24 18:31:19 [ayvens.es] INFO: Extracting data for car ID: 1981115
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1981115
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134af499-0832-5f1e-bd50-c4154915d586 with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 134af499-0832-5f1e-bd50-c4154915d586
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fa80057c6d078477f82ecfbe4318f7b7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/a80057c6d078477f82ecfbe4318f7b7d/images/large/1.jpg not downloaded yet
2026-03-24 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/080/a4f7d018182d4e4496e1f35831d2d646/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/538/1cf5cdf773694f869fdb675219e71022/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:19 [ayvens.es] INFO: Found listing with ID: 1981116
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981116%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [ayvens.es] INFO: Scrape type for 1981116: 1
2026-03-24 18:31:19 [ayvens.es] INFO: Extracting data for car ID: 1981116
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1981116
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73daa06e-9d23-555d-a406-f4fa780e970a with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73daa06e-9d23-555d-a406-f4fa780e970a
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F163%252Fa7c32f68706b4ecdba8659f08ef63714%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/163/a7c32f68706b4ecdba8659f08ef63714/images/large/1.jpg not downloaded yet
2026-03-24 18:31:19 [ayvens.es] INFO: Found listing with ID: 1981117
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981117%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [ayvens.es] INFO: Scrape type for 1981117: 1
2026-03-24 18:31:19 [ayvens.es] INFO: Extracting data for car ID: 1981117
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1981117
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe8660d-48ba-5d2b-b82c-8f885544e854 with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffe8660d-48ba-5d2b-b82c-8f885544e854
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252Fcf0126b8cfa345ae9f61f48611570b3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/cf0126b8cfa345ae9f61f48611570b3f/images/large/1.jpg not downloaded yet
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9742d0>
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbe0678-1b4f-528a-b1b7-776e309e7a9d/1fbe0678-1b4f-528a-b1b7-776e309e7a9d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F14c9f14956624f1db932e617fc3b9c9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/14c9f14956624f1db932e617fc3b9c9c/images/large/1.jpg saved to cache
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fbe0678-1b4f-528a-b1b7-776e309e7a9d
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fbe0678-1b4f-528a-b1b7-776e309e7a9d, skipping ID generation
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbe0678-1b4f-528a-b1b7-776e309e7a9d with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fbe0678-1b4f-528a-b1b7-776e309e7a9d sending to next pipeline
2026-03-24 18:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1fbe0678-1b4f-528a-b1b7-776e309e7a9d, identifier: 1981106
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea59690>
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0adba50b-99a8-577a-b615-98ef67d70604/0adba50b-99a8-577a-b615-98ef67d70604_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252Ff3723f6e1a214fe2afc8f5a53cec7d69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/f3723f6e1a214fe2afc8f5a53cec7d69/images/large/1.jpg saved to cache
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0adba50b-99a8-577a-b615-98ef67d70604
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0adba50b-99a8-577a-b615-98ef67d70604, skipping ID generation
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0adba50b-99a8-577a-b615-98ef67d70604 with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0adba50b-99a8-577a-b615-98ef67d70604 sending to next pipeline
2026-03-24 18:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0adba50b-99a8-577a-b615-98ef67d70604, identifier: 1981105
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9b15d0>
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83c5533f-ff6b-51ae-9b31-5b317912ad56/83c5533f-ff6b-51ae-9b31-5b317912ad56_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F8d046339f1554c81b38307fdcf6f8317%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/8d046339f1554c81b38307fdcf6f8317/images/large/1.jpg saved to cache
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83c5533f-ff6b-51ae-9b31-5b317912ad56
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83c5533f-ff6b-51ae-9b31-5b317912ad56, skipping ID generation
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c5533f-ff6b-51ae-9b31-5b317912ad56 with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83c5533f-ff6b-51ae-9b31-5b317912ad56 sending to next pipeline
2026-03-24 18:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 83c5533f-ff6b-51ae-9b31-5b317912ad56, identifier: 1981108
2026-03-24 18:31:19 [ayvens.es] INFO: Found listing with ID: 1981118
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981118%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [ayvens.es] INFO: Scrape type for 1981118: 1
2026-03-24 18:31:19 [ayvens.es] INFO: Extracting data for car ID: 1981118
2026-03-24 18:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e with identifier: 1981118
2026-03-24 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e with scrape type 1
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F43d6def81b6f41a698e7e22e759a46b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/43d6def81b6f41a698e7e22e759a46b7/images/large/1.jpg not downloaded yet
2026-03-24 18:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1fbe0678-1b4f-528a-b1b7-776e309e7a9d with identifier: 1981106
2026-03-24 18:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1fbe0678-1b4f-528a-b1b7-776e309e7a9d with identifier: 1981106
2026-03-24 18:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1fbe0678-1b4f-528a-b1b7-776e309e7a9d with identifier: 1981106 to the API
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/135/14c9f14956624f1db932e617fc3b9c9c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fbe0678-1b4f-528a-b1b7-776e309e7a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NT400 CABSTAR',
 'odometer': 52205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbe0678-1b4f-528a-b1b7-776e309e7a9d/1fbe0678-1b4f-528a-b1b7-776e309e7a9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/135/14c9f14956624f1db932e617fc3b9c9c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NT400 CABSTAR 35.13/2 Basico Caja Volquete Alum '
          'Media+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '35.13/2 Basico Caja Volquete Alum Media+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981106%27 HTTP/1.1" 200 None
2026-03-24 18:31:20 [ayvens.es] INFO: Saving data for 1981106: {'created_time': 1774377080.310746, 'last_price_update_time': 1774377080.310756, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981106') HTTP/1.1" 204 0
2026-03-24 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1981105
2026-03-24 18:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1981105
2026-03-24 18:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1981105 to the API
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/860/f3723f6e1a214fe2afc8f5a53cec7d69/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0adba50b-99a8-577a-b615-98ef67d70604',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NT400 CABSTAR',
 'odometer': 68818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0adba50b-99a8-577a-b615-98ef67d70604/0adba50b-99a8-577a-b615-98ef67d70604_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/860/f3723f6e1a214fe2afc8f5a53cec7d69/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NT400 CABSTAR 35.13/2 Basico CAL Cabina Abatible '
          'Media+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '35.13/2 Basico CAL Cabina Abatible Media+++Revisar peritacion+++',
 'vin': None,
 'year': 2018}
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981105%27 HTTP/1.1" 200 None
2026-03-24 18:31:20 [ayvens.es] INFO: Saving data for 1981105: {'created_time': 1774377080.716607, 'last_price_update_time': 1774377080.716617, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981105') HTTP/1.1" 204 0
2026-03-24 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 83c5533f-ff6b-51ae-9b31-5b317912ad56 with identifier: 1981108
2026-03-24 18:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 83c5533f-ff6b-51ae-9b31-5b317912ad56 with identifier: 1981108
2026-03-24 18:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 83c5533f-ff6b-51ae-9b31-5b317912ad56 with identifier: 1981108 to the API
2026-03-24 18:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/108/8d046339f1554c81b38307fdcf6f8317/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '83c5533f-ff6b-51ae-9b31-5b317912ad56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 153381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c5533f-ff6b-51ae-9b31-5b317912ad56/83c5533f-ff6b-51ae-9b31-5b317912ad56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/108/8d046339f1554c81b38307fdcf6f8317/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981108%27 HTTP/1.1" 200 None
2026-03-24 18:31:21 [ayvens.es] INFO: Saving data for 1981108: {'created_time': 1774377081.13255, 'last_price_update_time': 1774377081.132561, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981108') HTTP/1.1" 204 0
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6d7850>
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea1796-cbb0-53f9-a37b-7af4ea4c215b/f5ea1796-cbb0-53f9-a37b-7af4ea4c215b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F988%252Ff779d9c50b544935bbe250f2df04e633%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/988/f779d9c50b544935bbe250f2df04e633/images/large/1.jpg saved to cache
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5ea1796-cbb0-53f9-a37b-7af4ea4c215b
2026-03-24 18:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5ea1796-cbb0-53f9-a37b-7af4ea4c215b, skipping ID generation
2026-03-24 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ea1796-cbb0-53f9-a37b-7af4ea4c215b with scrape type 1
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5ea1796-cbb0-53f9-a37b-7af4ea4c215b sending to next pipeline
2026-03-24 18:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f5ea1796-cbb0-53f9-a37b-7af4ea4c215b, identifier: 1981107
2026-03-24 18:31:21 [ayvens.es] INFO: Found listing with ID: 1981119
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981119%27 HTTP/1.1" 200 None
2026-03-24 18:31:21 [ayvens.es] INFO: Scrape type for 1981119: 1
2026-03-24 18:31:21 [ayvens.es] INFO: Extracting data for car ID: 1981119
2026-03-24 18:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1981119
2026-03-24 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865ca659-f084-578e-a65a-cc21fc786178 with scrape type 1
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 865ca659-f084-578e-a65a-cc21fc786178
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F64368f53ed414be5a602c98582db42d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/64368f53ed414be5a602c98582db42d8/images/large/1.jpg not downloaded yet
2026-03-24 18:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f5ea1796-cbb0-53f9-a37b-7af4ea4c215b with identifier: 1981107
2026-03-24 18:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f5ea1796-cbb0-53f9-a37b-7af4ea4c215b with identifier: 1981107
2026-03-24 18:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f5ea1796-cbb0-53f9-a37b-7af4ea4c215b with identifier: 1981107 to the API
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/988/f779d9c50b544935bbe250f2df04e633/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f5ea1796-cbb0-53f9-a37b-7af4ea4c215b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 227672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea1796-cbb0-53f9-a37b-7af4ea4c215b/f5ea1796-cbb0-53f9-a37b-7af4ea4c215b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/988/f779d9c50b544935bbe250f2df04e633/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981107%27 HTTP/1.1" 200 None
2026-03-24 18:31:21 [ayvens.es] INFO: Saving data for 1981107: {'created_time': 1774377081.654199, 'last_price_update_time': 1774377081.654209, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981107') HTTP/1.1" 204 0
2026-03-24 18:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/539/889d04c1bf3e4a32801b74b96e8b7a11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea0a750>
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_916d34c5-301c-5fdf-988e-607779018868/916d34c5-301c-5fdf-988e-607779018868_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Fa4f7d018182d4e4496e1f35831d2d646%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/a4f7d018182d4e4496e1f35831d2d646/images/large/1.jpg saved to cache
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 916d34c5-301c-5fdf-988e-607779018868
2026-03-24 18:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 916d34c5-301c-5fdf-988e-607779018868, skipping ID generation
2026-03-24 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916d34c5-301c-5fdf-988e-607779018868 with scrape type 1
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 916d34c5-301c-5fdf-988e-607779018868 sending to next pipeline
2026-03-24 18:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 916d34c5-301c-5fdf-988e-607779018868, identifier: 1981109
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee70b590>
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aecbf63-f76f-5a76-918d-1e2f93aaec7c/1aecbf63-f76f-5a76-918d-1e2f93aaec7c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252F1cf5cdf773694f869fdb675219e71022%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/1cf5cdf773694f869fdb675219e71022/images/large/1.jpg saved to cache
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1aecbf63-f76f-5a76-918d-1e2f93aaec7c
2026-03-24 18:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1aecbf63-f76f-5a76-918d-1e2f93aaec7c, skipping ID generation
2026-03-24 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aecbf63-f76f-5a76-918d-1e2f93aaec7c with scrape type 1
2026-03-24 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1aecbf63-f76f-5a76-918d-1e2f93aaec7c sending to next pipeline
2026-03-24 18:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1aecbf63-f76f-5a76-918d-1e2f93aaec7c, identifier: 1981110
2026-03-24 18:31:21 [ayvens.es] INFO: Found listing with ID: 1981120
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981120%27 HTTP/1.1" 200 None
2026-03-24 18:31:22 [ayvens.es] INFO: Scrape type for 1981120: 1
2026-03-24 18:31:22 [ayvens.es] INFO: Extracting data for car ID: 1981120
2026-03-24 18:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1981120
2026-03-24 18:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08707f89-4f72-5a44-a17d-5218ef733f1a with scrape type 1
2026-03-24 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08707f89-4f72-5a44-a17d-5218ef733f1a
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F997%252F84643eed53bd4a2e86693d806990165b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/997/84643eed53bd4a2e86693d806990165b/images/large/1.jpg not downloaded yet
2026-03-24 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1981109
2026-03-24 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1981109
2026-03-24 18:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1981109 to the API
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/080/a4f7d018182d4e4496e1f35831d2d646/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'color': 'Verde',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '916d34c5-301c-5fdf-988e-607779018868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 136849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_916d34c5-301c-5fdf-988e-607779018868/916d34c5-301c-5fdf-988e-607779018868_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/080/a4f7d018182d4e4496e1f35831d2d646/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Bl dCi 100kW (135CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Bl dCi 100kW (135CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981109%27 HTTP/1.1" 200 None
2026-03-24 18:31:22 [ayvens.es] INFO: Saving data for 1981109: {'created_time': 1774377082.32815, 'last_price_update_time': 1774377082.328162, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981109') HTTP/1.1" 204 0
2026-03-24 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1aecbf63-f76f-5a76-918d-1e2f93aaec7c with identifier: 1981110
2026-03-24 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1aecbf63-f76f-5a76-918d-1e2f93aaec7c with identifier: 1981110
2026-03-24 18:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1aecbf63-f76f-5a76-918d-1e2f93aaec7c with identifier: 1981110 to the API
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/538/1cf5cdf773694f869fdb675219e71022/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1aecbf63-f76f-5a76-918d-1e2f93aaec7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 125276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aecbf63-f76f-5a76-918d-1e2f93aaec7c/1aecbf63-f76f-5a76-918d-1e2f93aaec7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/538/1cf5cdf773694f869fdb675219e71022/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 Energy BluedCi 88 kW+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 Energy BluedCi 88 kW+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981110%27 HTTP/1.1" 200 None
2026-03-24 18:31:22 [ayvens.es] INFO: Saving data for 1981110: {'created_time': 1774377082.688673, 'last_price_update_time': 1774377082.688682, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981110') HTTP/1.1" 204 0
2026-03-24 18:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/825/a3d156f6680a454090626e7b02baf042/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/625/88dee50f3b4c4d5ebf3eff78c7228f4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/585/e8e1c64c94154b31a827c3fd75c32131/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:22 [ayvens.es] INFO: Found listing with ID: 1981121
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981121%27 HTTP/1.1" 200 None
2026-03-24 18:31:22 [ayvens.es] INFO: Scrape type for 1981121: 1
2026-03-24 18:31:22 [ayvens.es] INFO: Extracting data for car ID: 1981121
2026-03-24 18:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1981121
2026-03-24 18:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with scrape type 1
2026-03-24 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252F637b10e3839a480cb4749798c8860833%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/637b10e3839a480cb4749798c8860833/images/large/1.jpg not downloaded yet
2026-03-24 18:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/a80057c6d078477f82ecfbe4318f7b7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7c71d0>
2026-03-24 18:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8c785d-d277-5452-b1f4-10dcbbd009b2/1a8c785d-d277-5452-b1f4-10dcbbd009b2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F539%252F889d04c1bf3e4a32801b74b96e8b7a11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/539/889d04c1bf3e4a32801b74b96e8b7a11/images/large/1.jpg saved to cache
2026-03-24 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2
2026-03-24 18:31:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a8c785d-d277-5452-b1f4-10dcbbd009b2, skipping ID generation
2026-03-24 18:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with scrape type 1
2026-03-24 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2 sending to next pipeline
2026-03-24 18:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a8c785d-d277-5452-b1f4-10dcbbd009b2, identifier: 1981111
2026-03-24 18:31:22 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-24 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1981111
2026-03-24 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1981111
2026-03-24 18:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1981111 to the API
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/539/889d04c1bf3e4a32801b74b96e8b7a11/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a8c785d-d277-5452-b1f4-10dcbbd009b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 30530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8c785d-d277-5452-b1f4-10dcbbd009b2/1a8c785d-d277-5452-b1f4-10dcbbd009b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/539/889d04c1bf3e4a32801b74b96e8b7a11/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981111%27 HTTP/1.1" 200 None
2026-03-24 18:31:23 [ayvens.es] INFO: Saving data for 1981111: {'created_time': 1774377083.271543, 'last_price_update_time': 1774377083.271553, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981111') HTTP/1.1" 204 0
2026-03-24 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/163/a7c32f68706b4ecdba8659f08ef63714/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/308/cf0126b8cfa345ae9f61f48611570b3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/482/43d6def81b6f41a698e7e22e759a46b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7ebbd0>
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f0c835f-93e2-5056-a03c-a73ca90875df/9f0c835f-93e2-5056-a03c-a73ca90875df_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F825%252Fa3d156f6680a454090626e7b02baf042%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/825/a3d156f6680a454090626e7b02baf042/images/large/1.jpg saved to cache
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f0c835f-93e2-5056-a03c-a73ca90875df
2026-03-24 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f0c835f-93e2-5056-a03c-a73ca90875df, skipping ID generation
2026-03-24 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0c835f-93e2-5056-a03c-a73ca90875df with scrape type 1
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f0c835f-93e2-5056-a03c-a73ca90875df sending to next pipeline
2026-03-24 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9f0c835f-93e2-5056-a03c-a73ca90875df, identifier: 1981113
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee203d10>
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9287a3d-df00-529b-8e81-12c212ce4ae0/b9287a3d-df00-529b-8e81-12c212ce4ae0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F625%252F88dee50f3b4c4d5ebf3eff78c7228f4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/625/88dee50f3b4c4d5ebf3eff78c7228f4c/images/large/1.jpg saved to cache
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9287a3d-df00-529b-8e81-12c212ce4ae0
2026-03-24 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9287a3d-df00-529b-8e81-12c212ce4ae0, skipping ID generation
2026-03-24 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9287a3d-df00-529b-8e81-12c212ce4ae0 with scrape type 1
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9287a3d-df00-529b-8e81-12c212ce4ae0 sending to next pipeline
2026-03-24 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9287a3d-df00-529b-8e81-12c212ce4ae0, identifier: 1981112
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee809890>
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce336c03-2f79-5688-998e-bad45e5068c8/ce336c03-2f79-5688-998e-bad45e5068c8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252Fe8e1c64c94154b31a827c3fd75c32131%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/e8e1c64c94154b31a827c3fd75c32131/images/large/1.jpg saved to cache
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce336c03-2f79-5688-998e-bad45e5068c8
2026-03-24 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce336c03-2f79-5688-998e-bad45e5068c8, skipping ID generation
2026-03-24 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce336c03-2f79-5688-998e-bad45e5068c8 with scrape type 1
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce336c03-2f79-5688-998e-bad45e5068c8 sending to next pipeline
2026-03-24 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce336c03-2f79-5688-998e-bad45e5068c8, identifier: 1981114
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee64090>
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_134af499-0832-5f1e-bd50-c4154915d586/134af499-0832-5f1e-bd50-c4154915d586_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fa80057c6d078477f82ecfbe4318f7b7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/a80057c6d078477f82ecfbe4318f7b7d/images/large/1.jpg saved to cache
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 134af499-0832-5f1e-bd50-c4154915d586
2026-03-24 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 134af499-0832-5f1e-bd50-c4154915d586, skipping ID generation
2026-03-24 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134af499-0832-5f1e-bd50-c4154915d586 with scrape type 1
2026-03-24 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 134af499-0832-5f1e-bd50-c4154915d586 sending to next pipeline
2026-03-24 18:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 134af499-0832-5f1e-bd50-c4154915d586, identifier: 1981115
2026-03-24 18:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/64368f53ed414be5a602c98582db42d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1981113
2026-03-24 18:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1981113
2026-03-24 18:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1981113 to the API
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/825/a3d156f6680a454090626e7b02baf042/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9f0c835f-93e2-5056-a03c-a73ca90875df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 13367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f0c835f-93e2-5056-a03c-a73ca90875df/9f0c835f-93e2-5056-a03c-a73ca90875df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/825/a3d156f6680a454090626e7b02baf042/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX+++Revisar peritacion+++',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981113%27 HTTP/1.1" 200 None
2026-03-24 18:31:24 [ayvens.es] INFO: Saving data for 1981113: {'created_time': 1774377084.499263, 'last_price_update_time': 1774377084.499275, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981113') HTTP/1.1" 204 0
2026-03-24 18:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1981112
2026-03-24 18:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1981112
2026-03-24 18:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1981112 to the API
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/625/88dee50f3b4c4d5ebf3eff78c7228f4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'b9287a3d-df00-529b-8e81-12c212ce4ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 103155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9287a3d-df00-529b-8e81-12c212ce4ae0/b9287a3d-df00-529b-8e81-12c212ce4ae0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/625/88dee50f3b4c4d5ebf3eff78c7228f4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (107CV) GLP+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (107CV) GLP+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981112%27 HTTP/1.1" 200 None
2026-03-24 18:31:24 [ayvens.es] INFO: Saving data for 1981112: {'created_time': 1774377084.860924, 'last_price_update_time': 1774377084.860939, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981112') HTTP/1.1" 204 0
2026-03-24 18:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1981114
2026-03-24 18:31:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1981114
2026-03-24 18:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1981114 to the API
2026-03-24 18:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/585/e8e1c64c94154b31a827c3fd75c32131/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce336c03-2f79-5688-998e-bad45e5068c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 217683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce336c03-2f79-5688-998e-bad45e5068c8/ce336c03-2f79-5688-998e-bad45e5068c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/585/e8e1c64c94154b31a827c3fd75c32131/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55kW (75CV) Euro 6+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55kW (75CV) Euro 6+++Revisar peritacion+++',
 'vin': None,
 'year': 2018}
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981114%27 HTTP/1.1" 200 None
2026-03-24 18:31:25 [ayvens.es] INFO: Saving data for 1981114: {'created_time': 1774377085.243508, 'last_price_update_time': 1774377085.243521, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981114') HTTP/1.1" 204 0
2026-03-24 18:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1981115
2026-03-24 18:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1981115
2026-03-24 18:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1981115 to the API
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/389/a80057c6d078477f82ecfbe4318f7b7d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '134af499-0832-5f1e-bd50-c4154915d586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 169000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134af499-0832-5f1e-bd50-c4154915d586/134af499-0832-5f1e-bd50-c4154915d586_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/a80057c6d078477f82ecfbe4318f7b7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 dCi 88kW (120CV)',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 dCi 88kW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981115%27 HTTP/1.1" 200 None
2026-03-24 18:31:25 [ayvens.es] INFO: Saving data for 1981115: {'created_time': 1774377085.598495, 'last_price_update_time': 1774377085.598515, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981115') HTTP/1.1" 204 0
2026-03-24 18:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/997/84643eed53bd4a2e86693d806990165b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee39dd0>
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73daa06e-9d23-555d-a406-f4fa780e970a/73daa06e-9d23-555d-a406-f4fa780e970a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F163%252Fa7c32f68706b4ecdba8659f08ef63714%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/163/a7c32f68706b4ecdba8659f08ef63714/images/large/1.jpg saved to cache
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73daa06e-9d23-555d-a406-f4fa780e970a
2026-03-24 18:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73daa06e-9d23-555d-a406-f4fa780e970a, skipping ID generation
2026-03-24 18:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73daa06e-9d23-555d-a406-f4fa780e970a with scrape type 1
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73daa06e-9d23-555d-a406-f4fa780e970a sending to next pipeline
2026-03-24 18:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 73daa06e-9d23-555d-a406-f4fa780e970a, identifier: 1981116
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee22df90>
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffe8660d-48ba-5d2b-b82c-8f885544e854/ffe8660d-48ba-5d2b-b82c-8f885544e854_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252Fcf0126b8cfa345ae9f61f48611570b3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/cf0126b8cfa345ae9f61f48611570b3f/images/large/1.jpg saved to cache
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffe8660d-48ba-5d2b-b82c-8f885544e854
2026-03-24 18:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffe8660d-48ba-5d2b-b82c-8f885544e854, skipping ID generation
2026-03-24 18:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe8660d-48ba-5d2b-b82c-8f885544e854 with scrape type 1
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffe8660d-48ba-5d2b-b82c-8f885544e854 sending to next pipeline
2026-03-24 18:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ffe8660d-48ba-5d2b-b82c-8f885544e854, identifier: 1981117
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee917e50>
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad8762d-ae01-59fc-9e9a-ff2b67a1209e/5ad8762d-ae01-59fc-9e9a-ff2b67a1209e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F43d6def81b6f41a698e7e22e759a46b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/43d6def81b6f41a698e7e22e759a46b7/images/large/1.jpg saved to cache
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e
2026-03-24 18:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e, skipping ID generation
2026-03-24 18:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e with scrape type 1
2026-03-24 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e sending to next pipeline
2026-03-24 18:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e, identifier: 1981118
2026-03-24 18:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1981116
2026-03-24 18:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1981116
2026-03-24 18:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1981116 to the API
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/163/a7c32f68706b4ecdba8659f08ef63714/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '73daa06e-9d23-555d-a406-f4fa780e970a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 177248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73daa06e-9d23-555d-a406-f4fa780e970a/73daa06e-9d23-555d-a406-f4fa780e970a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/163/a7c32f68706b4ecdba8659f08ef63714/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 320 L1 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 320 L1 Trend',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981116%27 HTTP/1.1" 200 None
2026-03-24 18:31:26 [ayvens.es] INFO: Saving data for 1981116: {'created_time': 1774377086.414605, 'last_price_update_time': 1774377086.414616, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981116') HTTP/1.1" 204 0
2026-03-24 18:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1981117
2026-03-24 18:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1981117
2026-03-24 18:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1981117 to the API
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/308/cf0126b8cfa345ae9f61f48611570b3f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'ffe8660d-48ba-5d2b-b82c-8f885544e854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 162379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe8660d-48ba-5d2b-b82c-8f885544e854/ffe8660d-48ba-5d2b-b82c-8f885544e854_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/cf0126b8cfa345ae9f61f48611570b3f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 75kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 75kW (100CV) GLP',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981117%27 HTTP/1.1" 200 None
2026-03-24 18:31:26 [ayvens.es] INFO: Saving data for 1981117: {'created_time': 1774377086.728089, 'last_price_update_time': 1774377086.7281, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981117') HTTP/1.1" 204 0
2026-03-24 18:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e with identifier: 1981118
2026-03-24 18:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e with identifier: 1981118
2026-03-24 18:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ad8762d-ae01-59fc-9e9a-ff2b67a1209e with identifier: 1981118 to the API
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/482/43d6def81b6f41a698e7e22e759a46b7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ad8762d-ae01-59fc-9e9a-ff2b67a1209e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 77907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad8762d-ae01-59fc-9e9a-ff2b67a1209e/5ad8762d-ae01-59fc-9e9a-ff2b67a1209e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/482/43d6def81b6f41a698e7e22e759a46b7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'transmission': 'manual',
 'trim': '2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'vin': None,
 'year': 2023}
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981118%27 HTTP/1.1" 200 None
2026-03-24 18:31:27 [ayvens.es] INFO: Saving data for 1981118: {'created_time': 1774377087.055134, 'last_price_update_time': 1774377087.055143, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981118') HTTP/1.1" 204 0
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9fb490>
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865ca659-f084-578e-a65a-cc21fc786178/865ca659-f084-578e-a65a-cc21fc786178_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F64368f53ed414be5a602c98582db42d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/64368f53ed414be5a602c98582db42d8/images/large/1.jpg saved to cache
2026-03-24 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 865ca659-f084-578e-a65a-cc21fc786178
2026-03-24 18:31:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 865ca659-f084-578e-a65a-cc21fc786178, skipping ID generation
2026-03-24 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865ca659-f084-578e-a65a-cc21fc786178 with scrape type 1
2026-03-24 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 865ca659-f084-578e-a65a-cc21fc786178 sending to next pipeline
2026-03-24 18:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 865ca659-f084-578e-a65a-cc21fc786178, identifier: 1981119
2026-03-24 18:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/746/637b10e3839a480cb4749798c8860833/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1981119
2026-03-24 18:31:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1981119
2026-03-24 18:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1981119 to the API
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/64368f53ed414be5a602c98582db42d8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '865ca659-f084-578e-a65a-cc21fc786178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 171256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865ca659-f084-578e-a65a-cc21fc786178/865ca659-f084-578e-a65a-cc21fc786178_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/64368f53ed414be5a602c98582db42d8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Premium 1.5 BlueHDi 100 Standard',
 'transmission': 'manual',
 'trim': 'Furgon Premium 1.5 BlueHDi 100 Standard',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981119%27 HTTP/1.1" 200 None
2026-03-24 18:31:27 [ayvens.es] INFO: Saving data for 1981119: {'created_time': 1774377087.576394, 'last_price_update_time': 1774377087.576404, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981119') HTTP/1.1" 204 0
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9b2990>
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08707f89-4f72-5a44-a17d-5218ef733f1a/08707f89-4f72-5a44-a17d-5218ef733f1a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F997%252F84643eed53bd4a2e86693d806990165b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/997/84643eed53bd4a2e86693d806990165b/images/large/1.jpg saved to cache
2026-03-24 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08707f89-4f72-5a44-a17d-5218ef733f1a
2026-03-24 18:31:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08707f89-4f72-5a44-a17d-5218ef733f1a, skipping ID generation
2026-03-24 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08707f89-4f72-5a44-a17d-5218ef733f1a with scrape type 1
2026-03-24 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08707f89-4f72-5a44-a17d-5218ef733f1a sending to next pipeline
2026-03-24 18:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 08707f89-4f72-5a44-a17d-5218ef733f1a, identifier: 1981120
2026-03-24 18:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1981120
2026-03-24 18:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1981120
2026-03-24 18:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1981120 to the API
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/997/84643eed53bd4a2e86693d806990165b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '08707f89-4f72-5a44-a17d-5218ef733f1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 105556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08707f89-4f72-5a44-a17d-5218ef733f1a/08707f89-4f72-5a44-a17d-5218ef733f1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/997/84643eed53bd4a2e86693d806990165b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981120%27 HTTP/1.1" 200 None
2026-03-24 18:31:28 [ayvens.es] INFO: Saving data for 1981120: {'created_time': 1774377088.05223, 'last_price_update_time': 1774377088.05224, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981120') HTTP/1.1" 204 0
2026-03-24 18:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed6f690>
2026-03-24 18:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf4a0179-eb29-5fa4-9b48-6be09a23b1e8/bf4a0179-eb29-5fa4-9b48-6be09a23b1e8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252F637b10e3839a480cb4749798c8860833%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/637b10e3839a480cb4749798c8860833/images/large/1.jpg saved to cache
2026-03-24 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8
2026-03-24 18:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8, skipping ID generation
2026-03-24 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with scrape type 1
2026-03-24 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 sending to next pipeline
2026-03-24 18:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8, identifier: 1981121
2026-03-24 18:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1981121
2026-03-24 18:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1981121
2026-03-24 18:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1981121 to the API
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/746/637b10e3839a480cb4749798c8860833/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf4a0179-eb29-5fa4-9b48-6be09a23b1e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 146873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf4a0179-eb29-5fa4-9b48-6be09a23b1e8/bf4a0179-eb29-5fa4-9b48-6be09a23b1e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/746/637b10e3839a480cb4749798c8860833/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981121%27 HTTP/1.1" 200 None
2026-03-24 18:31:28 [ayvens.es] INFO: Saving data for 1981121: {'created_time': 1774377088.590173, 'last_price_update_time': 1774377088.590183, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981121') HTTP/1.1" 204 0
2026-03-24 18:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981122
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981122%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981122: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981122
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1981122
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252Fe2e5cb2a14d8482c86e734d0b1b7634f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/e2e5cb2a14d8482c86e734d0b1b7634f/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981123
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981123%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981123: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981123
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 740093dd-c099-591b-ae5e-2a5fc13bb264 with identifier: 1981123
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 740093dd-c099-591b-ae5e-2a5fc13bb264 with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 740093dd-c099-591b-ae5e-2a5fc13bb264
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252Fdeb862b464334b6ab123b80f2a5e2730%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/deb862b464334b6ab123b80f2a5e2730/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981124
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981124%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981124: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981124
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1981124
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F344%252Ffd4cc21ee7cd45bda1c6a8748ac98c8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/344/fd4cc21ee7cd45bda1c6a8748ac98c8a/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981125
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981125%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981125: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981125
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1981125
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f2249a-beaf-59f9-be6b-f6564b531fea with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37f2249a-beaf-59f9-be6b-f6564b531fea
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252F3f31f33a853b4d2ebd16700386dfefe6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/3f31f33a853b4d2ebd16700386dfefe6/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981126
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981126%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981126: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981126
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16267400-2911-5721-ba4b-048da57c30f6 with identifier: 1981126
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16267400-2911-5721-ba4b-048da57c30f6 with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 16267400-2911-5721-ba4b-048da57c30f6
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F211%252Fd40b971d19a94378bb7c955fb499abef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/211/d40b971d19a94378bb7c955fb499abef/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981127
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981127%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981127: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981127
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f101297f-2178-5e91-b8eb-de3b05028188 with identifier: 1981127
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f101297f-2178-5e91-b8eb-de3b05028188 with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f101297f-2178-5e91-b8eb-de3b05028188
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F325%252F2c4cb3c054a542f19d6523192829788c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/325/2c4cb3c054a542f19d6523192829788c/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981128
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981128%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981128: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981128
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08a015b-4776-57c7-9d53-74eb05ccff97 with identifier: 1981128
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08a015b-4776-57c7-9d53-74eb05ccff97 with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c08a015b-4776-57c7-9d53-74eb05ccff97
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252Fe650a12c04d44e5fbcb150d44295194f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/e650a12c04d44e5fbcb150d44295194f/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981129
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981129%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981129: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981129
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1981129
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32628796-c6f9-5c88-954e-d8d37c6d99d9 with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 32628796-c6f9-5c88-954e-d8d37c6d99d9
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F057eaa22fdef403fa6b2eca5aa1faf8c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/057eaa22fdef403fa6b2eca5aa1faf8c/images/large/1.jpg not downloaded yet
2026-03-24 18:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/100/deb862b464334b6ab123b80f2a5e2730/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:29 [ayvens.es] INFO: Found listing with ID: 1981130
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981130%27 HTTP/1.1" 200 None
2026-03-24 18:31:29 [ayvens.es] INFO: Scrape type for 1981130: 1
2026-03-24 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1981130
2026-03-24 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1981130
2026-03-24 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96cbe08-2793-5e96-bb7a-487a10af7629 with scrape type 1
2026-03-24 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e96cbe08-2793-5e96-bb7a-487a10af7629
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F61f159facbb24eb5b79c498ab6ae3060%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/61f159facbb24eb5b79c498ab6ae3060/images/large/1.jpg not downloaded yet
2026-03-24 18:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/338/e2e5cb2a14d8482c86e734d0b1b7634f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:30 [ayvens.es] INFO: Found listing with ID: 1981131
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981131%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [ayvens.es] INFO: Scrape type for 1981131: 1
2026-03-24 18:31:30 [ayvens.es] INFO: Extracting data for car ID: 1981131
2026-03-24 18:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1981131
2026-03-24 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498b659f-5233-54b5-9aab-0c00c61da854 with scrape type 1
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 498b659f-5233-54b5-9aab-0c00c61da854
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252Fb58b6b4b95de454d873da8c2323ae243%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/b58b6b4b95de454d873da8c2323ae243/images/large/1.jpg not downloaded yet
2026-03-24 18:31:30 [ayvens.es] INFO: Found listing with ID: 1981132
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981132%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [ayvens.es] INFO: Scrape type for 1981132: 1
2026-03-24 18:31:30 [ayvens.es] INFO: Extracting data for car ID: 1981132
2026-03-24 18:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1981132
2026-03-24 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with scrape type 1
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F7d84eebe62a94d8f9faba445417da6c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/7d84eebe62a94d8f9faba445417da6c8/images/large/1.jpg not downloaded yet
2026-03-24 18:31:30 [ayvens.es] INFO: Found listing with ID: 1981133
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981133%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [ayvens.es] INFO: Scrape type for 1981133: 1
2026-03-24 18:31:30 [ayvens.es] INFO: Extracting data for car ID: 1981133
2026-03-24 18:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9 with identifier: 1981133
2026-03-24 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9 with scrape type 1
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F168%252Fb6c8fde670554010a6a9961cd8eb79a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/168/b6c8fde670554010a6a9961cd8eb79a9/images/large/1.jpg not downloaded yet
2026-03-24 18:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eec18110>
2026-03-24 18:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_740093dd-c099-591b-ae5e-2a5fc13bb264/740093dd-c099-591b-ae5e-2a5fc13bb264_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252Fdeb862b464334b6ab123b80f2a5e2730%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/deb862b464334b6ab123b80f2a5e2730/images/large/1.jpg saved to cache
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 740093dd-c099-591b-ae5e-2a5fc13bb264
2026-03-24 18:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 740093dd-c099-591b-ae5e-2a5fc13bb264, skipping ID generation
2026-03-24 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 740093dd-c099-591b-ae5e-2a5fc13bb264 with scrape type 1
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 740093dd-c099-591b-ae5e-2a5fc13bb264 sending to next pipeline
2026-03-24 18:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 740093dd-c099-591b-ae5e-2a5fc13bb264, identifier: 1981123
2026-03-24 18:31:30 [ayvens.es] INFO: Found listing with ID: 1981134
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981134%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [ayvens.es] INFO: Scrape type for 1981134: 1
2026-03-24 18:31:30 [ayvens.es] INFO: Extracting data for car ID: 1981134
2026-03-24 18:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a30043c1-7533-575e-b7ca-abf8ac6998fd with identifier: 1981134
2026-03-24 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a30043c1-7533-575e-b7ca-abf8ac6998fd with scrape type 1
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a30043c1-7533-575e-b7ca-abf8ac6998fd
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F916%252F0cd6543693f542e697c2cbf3c2d97a0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/916/0cd6543693f542e697c2cbf3c2d97a0d/images/large/1.jpg not downloaded yet
2026-03-24 18:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 740093dd-c099-591b-ae5e-2a5fc13bb264 with identifier: 1981123
2026-03-24 18:31:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 740093dd-c099-591b-ae5e-2a5fc13bb264 with identifier: 1981123
2026-03-24 18:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 740093dd-c099-591b-ae5e-2a5fc13bb264 with identifier: 1981123 to the API
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/100/deb862b464334b6ab123b80f2a5e2730/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '740093dd-c099-591b-ae5e-2a5fc13bb264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 44855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_740093dd-c099-591b-ae5e-2a5fc13bb264/740093dd-c099-591b-ae5e-2a5fc13bb264_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/100/deb862b464334b6ab123b80f2a5e2730/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.0 EcoBoost 75kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.0 EcoBoost 75kW Trend',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981123%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [ayvens.es] INFO: Saving data for 1981123: {'created_time': 1774377090.815603, 'last_price_update_time': 1774377090.815615, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981123') HTTP/1.1" 204 0
2026-03-24 18:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/379/3f31f33a853b4d2ebd16700386dfefe6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:30 [ayvens.es] INFO: Found listing with ID: 1981227
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981227%27 HTTP/1.1" 200 None
2026-03-24 18:31:30 [ayvens.es] INFO: Scrape type for 1981227: 1
2026-03-24 18:31:30 [ayvens.es] INFO: Extracting data for car ID: 1981227
2026-03-24 18:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1981227
2026-03-24 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221294ac-7579-56cd-81f8-bec708739866 with scrape type 1
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 221294ac-7579-56cd-81f8-bec708739866
2026-03-24 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 221294ac-7579-56cd-81f8-bec708739866
2026-03-24 18:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 221294ac-7579-56cd-81f8-bec708739866, identifier: 1981227
2026-03-24 18:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea596d0>
2026-03-24 18:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d3605b-d2b1-5a4d-a345-bee80f04d98e/58d3605b-d2b1-5a4d-a345-bee80f04d98e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252Fe2e5cb2a14d8482c86e734d0b1b7634f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/e2e5cb2a14d8482c86e734d0b1b7634f/images/large/1.jpg saved to cache
2026-03-24 18:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e
2026-03-24 18:31:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58d3605b-d2b1-5a4d-a345-bee80f04d98e, skipping ID generation
2026-03-24 18:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e with scrape type 1
2026-03-24 18:31:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e sending to next pipeline
2026-03-24 18:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 58d3605b-d2b1-5a4d-a345-bee80f04d98e, identifier: 1981122
2026-03-24 18:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/325/2c4cb3c054a542f19d6523192829788c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/344/fd4cc21ee7cd45bda1c6a8748ac98c8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1981227
2026-03-24 18:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1981227
2026-03-24 18:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1981227 to the API
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '221294ac-7579-56cd-81f8-bec708739866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 38426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981227%27 HTTP/1.1" 200 None
2026-03-24 18:31:31 [ayvens.es] INFO: Saving data for 1981227: {'created_time': 1774377091.868657, 'last_price_update_time': 1774377091.868667, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981227') HTTP/1.1" 204 0
2026-03-24 18:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1981122
2026-03-24 18:31:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1981122
2026-03-24 18:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1981122 to the API
2026-03-24 18:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/338/e2e5cb2a14d8482c86e734d0b1b7634f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Rojo vivo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '58d3605b-d2b1-5a4d-a345-bee80f04d98e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 112942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d3605b-d2b1-5a4d-a345-bee80f04d98e/58d3605b-d2b1-5a4d-a345-bee80f04d98e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/338/e2e5cb2a14d8482c86e734d0b1b7634f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981122%27 HTTP/1.1" 200 None
2026-03-24 18:31:32 [ayvens.es] INFO: Saving data for 1981122: {'created_time': 1774377092.187504, 'last_price_update_time': 1774377092.187515, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981122') HTTP/1.1" 204 0
2026-03-24 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/211/d40b971d19a94378bb7c955fb499abef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/057eaa22fdef403fa6b2eca5aa1faf8c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:32 [ayvens.es] INFO: Found listing with ID: 1981228
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981228%27 HTTP/1.1" 200 None
2026-03-24 18:31:32 [ayvens.es] INFO: Scrape type for 1981228: 1
2026-03-24 18:31:32 [ayvens.es] INFO: Extracting data for car ID: 1981228
2026-03-24 18:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1981228
2026-03-24 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with scrape type 1
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F550%252F1a412819330f420abf651e181214fed9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/550/1a412819330f420abf651e181214fed9/images/large/1.jpg not downloaded yet
2026-03-24 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/235/e650a12c04d44e5fbcb150d44295194f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/774/b58b6b4b95de454d873da8c2323ae243/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/626/61f159facbb24eb5b79c498ab6ae3060/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:32 [ayvens.es] INFO: Found listing with ID: 1981229
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981229%27 HTTP/1.1" 200 None
2026-03-24 18:31:32 [ayvens.es] INFO: Scrape type for 1981229: 1
2026-03-24 18:31:32 [ayvens.es] INFO: Extracting data for car ID: 1981229
2026-03-24 18:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d398ff69-f4fd-5d84-9c0f-c7a132afd8a9 with identifier: 1981229
2026-03-24 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d398ff69-f4fd-5d84-9c0f-c7a132afd8a9 with scrape type 1
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d398ff69-f4fd-5d84-9c0f-c7a132afd8a9
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252F843044be84fc4db0a2de0e93299062e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/843044be84fc4db0a2de0e93299062e3/images/large/1.jpg not downloaded yet
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee920890>
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f2249a-beaf-59f9-be6b-f6564b531fea/37f2249a-beaf-59f9-be6b-f6564b531fea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252F3f31f33a853b4d2ebd16700386dfefe6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/3f31f33a853b4d2ebd16700386dfefe6/images/large/1.jpg saved to cache
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37f2249a-beaf-59f9-be6b-f6564b531fea
2026-03-24 18:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37f2249a-beaf-59f9-be6b-f6564b531fea, skipping ID generation
2026-03-24 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f2249a-beaf-59f9-be6b-f6564b531fea with scrape type 1
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37f2249a-beaf-59f9-be6b-f6564b531fea sending to next pipeline
2026-03-24 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 37f2249a-beaf-59f9-be6b-f6564b531fea, identifier: 1981125
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7df050>
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101297f-2178-5e91-b8eb-de3b05028188/f101297f-2178-5e91-b8eb-de3b05028188_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F325%252F2c4cb3c054a542f19d6523192829788c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/325/2c4cb3c054a542f19d6523192829788c/images/large/1.jpg saved to cache
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f101297f-2178-5e91-b8eb-de3b05028188
2026-03-24 18:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f101297f-2178-5e91-b8eb-de3b05028188, skipping ID generation
2026-03-24 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f101297f-2178-5e91-b8eb-de3b05028188 with scrape type 1
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f101297f-2178-5e91-b8eb-de3b05028188 sending to next pipeline
2026-03-24 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f101297f-2178-5e91-b8eb-de3b05028188, identifier: 1981127
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8d3e50>
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f9aae0-5f59-5c73-8e11-fcbb51169db5/80f9aae0-5f59-5c73-8e11-fcbb51169db5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F344%252Ffd4cc21ee7cd45bda1c6a8748ac98c8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/344/fd4cc21ee7cd45bda1c6a8748ac98c8a/images/large/1.jpg saved to cache
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5
2026-03-24 18:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80f9aae0-5f59-5c73-8e11-fcbb51169db5, skipping ID generation
2026-03-24 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with scrape type 1
2026-03-24 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5 sending to next pipeline
2026-03-24 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 80f9aae0-5f59-5c73-8e11-fcbb51169db5, identifier: 1981124
2026-03-24 18:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1981125
2026-03-24 18:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1981125
2026-03-24 18:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1981125 to the API
2026-03-24 18:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/379/3f31f33a853b4d2ebd16700386dfefe6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '37f2249a-beaf-59f9-be6b-f6564b531fea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 224901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f2249a-beaf-59f9-be6b-f6564b531fea/37f2249a-beaf-59f9-be6b-f6564b531fea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/379/3f31f33a853b4d2ebd16700386dfefe6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981125%27 HTTP/1.1" 200 None
2026-03-24 18:31:33 [ayvens.es] INFO: Saving data for 1981125: {'created_time': 1774377093.128519, 'last_price_update_time': 1774377093.12853, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981125') HTTP/1.1" 204 0
2026-03-24 18:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f101297f-2178-5e91-b8eb-de3b05028188 with identifier: 1981127
2026-03-24 18:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f101297f-2178-5e91-b8eb-de3b05028188 with identifier: 1981127
2026-03-24 18:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f101297f-2178-5e91-b8eb-de3b05028188 with identifier: 1981127 to the API
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/325/2c4cb3c054a542f19d6523192829788c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f101297f-2178-5e91-b8eb-de3b05028188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 19081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101297f-2178-5e91-b8eb-de3b05028188/f101297f-2178-5e91-b8eb-de3b05028188_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/325/2c4cb3c054a542f19d6523192829788c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Bl dCi 99kW (135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Bl dCi 99kW (135CV)',
 'vin': None,
 'year': 2023}
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981127%27 HTTP/1.1" 200 None
2026-03-24 18:31:33 [ayvens.es] INFO: Saving data for 1981127: {'created_time': 1774377093.456732, 'last_price_update_time': 1774377093.456742, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981127') HTTP/1.1" 204 0
2026-03-24 18:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1981124
2026-03-24 18:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1981124
2026-03-24 18:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1981124 to the API
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/344/fd4cc21ee7cd45bda1c6a8748ac98c8a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '80f9aae0-5f59-5c73-8e11-fcbb51169db5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 119886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f9aae0-5f59-5c73-8e11-fcbb51169db5/80f9aae0-5f59-5c73-8e11-fcbb51169db5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/344/fd4cc21ee7cd45bda1c6a8748ac98c8a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2023}
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981124%27 HTTP/1.1" 200 None
2026-03-24 18:31:33 [ayvens.es] INFO: Saving data for 1981124: {'created_time': 1774377093.77223, 'last_price_update_time': 1774377093.772239, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981124') HTTP/1.1" 204 0
2026-03-24 18:31:33 [ayvens.es] INFO: Found listing with ID: 1981230
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981230%27 HTTP/1.1" 200 None
2026-03-24 18:31:33 [ayvens.es] INFO: Scrape type for 1981230: 1
2026-03-24 18:31:33 [ayvens.es] INFO: Extracting data for car ID: 1981230
2026-03-24 18:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1981230
2026-03-24 18:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with scrape type 1
2026-03-24 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252Fe2b441a1b03f4e9f9b26a735d54a539e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/e2b441a1b03f4e9f9b26a735d54a539e/images/large/1.jpg not downloaded yet
2026-03-24 18:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8948d0>
2026-03-24 18:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16267400-2911-5721-ba4b-048da57c30f6/16267400-2911-5721-ba4b-048da57c30f6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F211%252Fd40b971d19a94378bb7c955fb499abef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/211/d40b971d19a94378bb7c955fb499abef/images/large/1.jpg saved to cache
2026-03-24 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16267400-2911-5721-ba4b-048da57c30f6
2026-03-24 18:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16267400-2911-5721-ba4b-048da57c30f6, skipping ID generation
2026-03-24 18:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16267400-2911-5721-ba4b-048da57c30f6 with scrape type 1
2026-03-24 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16267400-2911-5721-ba4b-048da57c30f6 sending to next pipeline
2026-03-24 18:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 16267400-2911-5721-ba4b-048da57c30f6, identifier: 1981126
2026-03-24 18:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee251a90>
2026-03-24 18:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32628796-c6f9-5c88-954e-d8d37c6d99d9/32628796-c6f9-5c88-954e-d8d37c6d99d9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F057eaa22fdef403fa6b2eca5aa1faf8c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/057eaa22fdef403fa6b2eca5aa1faf8c/images/large/1.jpg saved to cache
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32628796-c6f9-5c88-954e-d8d37c6d99d9
2026-03-24 18:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32628796-c6f9-5c88-954e-d8d37c6d99d9, skipping ID generation
2026-03-24 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32628796-c6f9-5c88-954e-d8d37c6d99d9 with scrape type 1
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32628796-c6f9-5c88-954e-d8d37c6d99d9 sending to next pipeline
2026-03-24 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 32628796-c6f9-5c88-954e-d8d37c6d99d9, identifier: 1981129
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb20810>
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c08a015b-4776-57c7-9d53-74eb05ccff97/c08a015b-4776-57c7-9d53-74eb05ccff97_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252Fe650a12c04d44e5fbcb150d44295194f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/e650a12c04d44e5fbcb150d44295194f/images/large/1.jpg saved to cache
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c08a015b-4776-57c7-9d53-74eb05ccff97
2026-03-24 18:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c08a015b-4776-57c7-9d53-74eb05ccff97, skipping ID generation
2026-03-24 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08a015b-4776-57c7-9d53-74eb05ccff97 with scrape type 1
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c08a015b-4776-57c7-9d53-74eb05ccff97 sending to next pipeline
2026-03-24 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c08a015b-4776-57c7-9d53-74eb05ccff97, identifier: 1981128
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed44c10>
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498b659f-5233-54b5-9aab-0c00c61da854/498b659f-5233-54b5-9aab-0c00c61da854_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252Fb58b6b4b95de454d873da8c2323ae243%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/b58b6b4b95de454d873da8c2323ae243/images/large/1.jpg saved to cache
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 498b659f-5233-54b5-9aab-0c00c61da854
2026-03-24 18:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 498b659f-5233-54b5-9aab-0c00c61da854, skipping ID generation
2026-03-24 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498b659f-5233-54b5-9aab-0c00c61da854 with scrape type 1
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 498b659f-5233-54b5-9aab-0c00c61da854 sending to next pipeline
2026-03-24 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 498b659f-5233-54b5-9aab-0c00c61da854, identifier: 1981131
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee1c790>
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96cbe08-2793-5e96-bb7a-487a10af7629/e96cbe08-2793-5e96-bb7a-487a10af7629_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F61f159facbb24eb5b79c498ab6ae3060%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/61f159facbb24eb5b79c498ab6ae3060/images/large/1.jpg saved to cache
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e96cbe08-2793-5e96-bb7a-487a10af7629
2026-03-24 18:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e96cbe08-2793-5e96-bb7a-487a10af7629, skipping ID generation
2026-03-24 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96cbe08-2793-5e96-bb7a-487a10af7629 with scrape type 1
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e96cbe08-2793-5e96-bb7a-487a10af7629 sending to next pipeline
2026-03-24 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e96cbe08-2793-5e96-bb7a-487a10af7629, identifier: 1981130
2026-03-24 18:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/292/7d84eebe62a94d8f9faba445417da6c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:34 [ayvens.es] INFO: Found listing with ID: 1981231
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981231%27 HTTP/1.1" 200 None
2026-03-24 18:31:34 [ayvens.es] INFO: Scrape type for 1981231: 1
2026-03-24 18:31:34 [ayvens.es] INFO: Extracting data for car ID: 1981231
2026-03-24 18:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1981231
2026-03-24 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with scrape type 1
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F553%252Fe3bb556de15d4168907ab704cac4440a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/553/e3bb556de15d4168907ab704cac4440a/images/large/1.jpg not downloaded yet
2026-03-24 18:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 16267400-2911-5721-ba4b-048da57c30f6 with identifier: 1981126
2026-03-24 18:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 16267400-2911-5721-ba4b-048da57c30f6 with identifier: 1981126
2026-03-24 18:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 16267400-2911-5721-ba4b-048da57c30f6 with identifier: 1981126 to the API
2026-03-24 18:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/211/d40b971d19a94378bb7c955fb499abef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '16267400-2911-5721-ba4b-048da57c30f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 176349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16267400-2911-5721-ba4b-048da57c30f6/16267400-2911-5721-ba4b-048da57c30f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/211/d40b971d19a94378bb7c955fb499abef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2018}
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981126%27 HTTP/1.1" 200 None
2026-03-24 18:31:35 [ayvens.es] INFO: Saving data for 1981126: {'created_time': 1774377095.153026, 'last_price_update_time': 1774377095.153036, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981126') HTTP/1.1" 204 0
2026-03-24 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1981129
2026-03-24 18:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1981129
2026-03-24 18:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1981129 to the API
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/057eaa22fdef403fa6b2eca5aa1faf8c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '32628796-c6f9-5c88-954e-d8d37c6d99d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 79887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32628796-c6f9-5c88-954e-d8d37c6d99d9/32628796-c6f9-5c88-954e-d8d37c6d99d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/057eaa22fdef403fa6b2eca5aa1faf8c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981129%27 HTTP/1.1" 200 None
2026-03-24 18:31:35 [ayvens.es] INFO: Saving data for 1981129: {'created_time': 1774377095.469239, 'last_price_update_time': 1774377095.469248, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981129') HTTP/1.1" 204 0
2026-03-24 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c08a015b-4776-57c7-9d53-74eb05ccff97 with identifier: 1981128
2026-03-24 18:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c08a015b-4776-57c7-9d53-74eb05ccff97 with identifier: 1981128
2026-03-24 18:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c08a015b-4776-57c7-9d53-74eb05ccff97 with identifier: 1981128 to the API
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/235/e650a12c04d44e5fbcb150d44295194f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c08a015b-4776-57c7-9d53-74eb05ccff97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 49512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c08a015b-4776-57c7-9d53-74eb05ccff97/c08a015b-4776-57c7-9d53-74eb05ccff97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/235/e650a12c04d44e5fbcb150d44295194f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Kombi 1.5 TDCi 71kW Trend',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 71kW Trend',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981128%27 HTTP/1.1" 200 None
2026-03-24 18:31:35 [ayvens.es] INFO: Saving data for 1981128: {'created_time': 1774377095.809722, 'last_price_update_time': 1774377095.809732, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981128') HTTP/1.1" 204 0
2026-03-24 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1981131
2026-03-24 18:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1981131
2026-03-24 18:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1981131 to the API
2026-03-24 18:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/774/b58b6b4b95de454d873da8c2323ae243/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '498b659f-5233-54b5-9aab-0c00c61da854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 213674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498b659f-5233-54b5-9aab-0c00c61da854/498b659f-5233-54b5-9aab-0c00c61da854_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/774/b58b6b4b95de454d873da8c2323ae243/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seats_number': 6,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Mixto N1 5/6 Energy Blue dCi 88 kW',
 'transmission': 'manual',
 'trim': 'Mixto N1 5/6 Energy Blue dCi 88 kW',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981131%27 HTTP/1.1" 200 None
2026-03-24 18:31:36 [ayvens.es] INFO: Saving data for 1981131: {'created_time': 1774377096.170647, 'last_price_update_time': 1774377096.170657, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981131') HTTP/1.1" 204 0
2026-03-24 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1981130
2026-03-24 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1981130
2026-03-24 18:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1981130 to the API
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/626/61f159facbb24eb5b79c498ab6ae3060/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e96cbe08-2793-5e96-bb7a-487a10af7629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 115083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96cbe08-2793-5e96-bb7a-487a10af7629/e96cbe08-2793-5e96-bb7a-487a10af7629_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/626/61f159facbb24eb5b79c498ab6ae3060/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2018}
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981130%27 HTTP/1.1" 200 None
2026-03-24 18:31:36 [ayvens.es] INFO: Saving data for 1981130: {'created_time': 1774377096.492438, 'last_price_update_time': 1774377096.492449, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981130') HTTP/1.1" 204 0
2026-03-24 18:31:36 [ayvens.es] INFO: Found listing with ID: 1981232
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981232%27 HTTP/1.1" 200 None
2026-03-24 18:31:36 [ayvens.es] INFO: Scrape type for 1981232: 1
2026-03-24 18:31:36 [ayvens.es] INFO: Extracting data for car ID: 1981232
2026-03-24 18:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1981232
2026-03-24 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with scrape type 1
2026-03-24 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F4af94cfca0a749cab4608ce0a618cee2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/4af94cfca0a749cab4608ce0a618cee2/images/large/1.jpg not downloaded yet
2026-03-24 18:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/168/b6c8fde670554010a6a9961cd8eb79a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/916/0cd6543693f542e697c2cbf3c2d97a0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9eda90>
2026-03-24 18:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f1d7898-ca26-5b23-9234-beeb1e756bb9/6f1d7898-ca26-5b23-9234-beeb1e756bb9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F7d84eebe62a94d8f9faba445417da6c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/7d84eebe62a94d8f9faba445417da6c8/images/large/1.jpg saved to cache
2026-03-24 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9
2026-03-24 18:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f1d7898-ca26-5b23-9234-beeb1e756bb9, skipping ID generation
2026-03-24 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with scrape type 1
2026-03-24 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9 sending to next pipeline
2026-03-24 18:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6f1d7898-ca26-5b23-9234-beeb1e756bb9, identifier: 1981132
2026-03-24 18:31:36 [ayvens.es] INFO: Found listing with ID: 1981233
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981233%27 HTTP/1.1" 200 None
2026-03-24 18:31:36 [ayvens.es] INFO: Scrape type for 1981233: 1
2026-03-24 18:31:36 [ayvens.es] INFO: Extracting data for car ID: 1981233
2026-03-24 18:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e60203a-5529-5bef-bfe2-b5f80008f875 with identifier: 1981233
2026-03-24 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e60203a-5529-5bef-bfe2-b5f80008f875 with scrape type 1
2026-03-24 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e60203a-5529-5bef-bfe2-b5f80008f875
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F304%252F0b8584d0ae8140609f3f6aad7f483ed0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/304/0b8584d0ae8140609f3f6aad7f483ed0/images/large/1.jpg not downloaded yet
2026-03-24 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1981132
2026-03-24 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1981132
2026-03-24 18:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1981132 to the API
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/292/7d84eebe62a94d8f9faba445417da6c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6f1d7898-ca26-5b23-9234-beeb1e756bb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 101926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f1d7898-ca26-5b23-9234-beeb1e756bb9/6f1d7898-ca26-5b23-9234-beeb1e756bb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/292/7d84eebe62a94d8f9faba445417da6c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981132%27 HTTP/1.1" 200 None
2026-03-24 18:31:37 [ayvens.es] INFO: Saving data for 1981132: {'created_time': 1774377097.042548, 'last_price_update_time': 1774377097.042557, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981132') HTTP/1.1" 204 0
2026-03-24 18:31:37 [ayvens.es] INFO: Found listing with ID: 1981234
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981234%27 HTTP/1.1" 200 None
2026-03-24 18:31:37 [ayvens.es] INFO: Scrape type for 1981234: 1
2026-03-24 18:31:37 [ayvens.es] INFO: Extracting data for car ID: 1981234
2026-03-24 18:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1981234
2026-03-24 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with scrape type 1
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252Fcec0284a02314ade8a95a72f3afaa6f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/cec0284a02314ade8a95a72f3afaa6f5/images/large/1.jpg not downloaded yet
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9ece90>
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9/8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F168%252Fb6c8fde670554010a6a9961cd8eb79a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/168/b6c8fde670554010a6a9961cd8eb79a9/images/large/1.jpg saved to cache
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9
2026-03-24 18:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9, skipping ID generation
2026-03-24 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9 with scrape type 1
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9 sending to next pipeline
2026-03-24 18:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9, identifier: 1981133
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee968ed0>
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a30043c1-7533-575e-b7ca-abf8ac6998fd/a30043c1-7533-575e-b7ca-abf8ac6998fd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F916%252F0cd6543693f542e697c2cbf3c2d97a0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/916/0cd6543693f542e697c2cbf3c2d97a0d/images/large/1.jpg saved to cache
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a30043c1-7533-575e-b7ca-abf8ac6998fd
2026-03-24 18:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a30043c1-7533-575e-b7ca-abf8ac6998fd, skipping ID generation
2026-03-24 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a30043c1-7533-575e-b7ca-abf8ac6998fd with scrape type 1
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a30043c1-7533-575e-b7ca-abf8ac6998fd sending to next pipeline
2026-03-24 18:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a30043c1-7533-575e-b7ca-abf8ac6998fd, identifier: 1981134
2026-03-24 18:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/550/1a412819330f420abf651e181214fed9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:37 [ayvens.es] INFO: Found listing with ID: 1981235
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981235%27 HTTP/1.1" 200 None
2026-03-24 18:31:37 [ayvens.es] INFO: Scrape type for 1981235: 1
2026-03-24 18:31:37 [ayvens.es] INFO: Extracting data for car ID: 1981235
2026-03-24 18:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1981235
2026-03-24 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2983285f-b6e9-519c-b21d-2d9dce5c6475 with scrape type 1
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2983285f-b6e9-519c-b21d-2d9dce5c6475
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252F8e9ab07712df45fc8aff84a3d87dbe45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/8e9ab07712df45fc8aff84a3d87dbe45/images/large/1.jpg not downloaded yet
2026-03-24 18:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9 with identifier: 1981133
2026-03-24 18:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9 with identifier: 1981133
2026-03-24 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9 with identifier: 1981133 to the API
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/168/b6c8fde670554010a6a9961cd8eb79a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura blanco glaci',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 205533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9/8ea2ccc7-32ab-5ba2-8ad4-efa3b87caec9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/168/b6c8fde670554010a6a9961cd8eb79a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981133%27 HTTP/1.1" 200 None
2026-03-24 18:31:37 [ayvens.es] INFO: Saving data for 1981133: {'created_time': 1774377097.832274, 'last_price_update_time': 1774377097.832286, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981133') HTTP/1.1" 204 0
2026-03-24 18:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a30043c1-7533-575e-b7ca-abf8ac6998fd with identifier: 1981134
2026-03-24 18:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a30043c1-7533-575e-b7ca-abf8ac6998fd with identifier: 1981134
2026-03-24 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a30043c1-7533-575e-b7ca-abf8ac6998fd with identifier: 1981134 to the API
2026-03-24 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/916/0cd6543693f542e697c2cbf3c2d97a0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a30043c1-7533-575e-b7ca-abf8ac6998fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40982',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 157704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a30043c1-7533-575e-b7ca-abf8ac6998fd/a30043c1-7533-575e-b7ca-abf8ac6998fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/916/0cd6543693f542e697c2cbf3c2d97a0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981134%27 HTTP/1.1" 200 None
2026-03-24 18:31:38 [ayvens.es] INFO: Saving data for 1981134: {'created_time': 1774377098.183558, 'last_price_update_time': 1774377098.183569, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981134') HTTP/1.1" 204 0
2026-03-24 18:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/477/e2b441a1b03f4e9f9b26a735d54a539e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:38 [ayvens.es] INFO: Found listing with ID: 1981236
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981236%27 HTTP/1.1" 200 None
2026-03-24 18:31:38 [ayvens.es] INFO: Scrape type for 1981236: 1
2026-03-24 18:31:38 [ayvens.es] INFO: Extracting data for car ID: 1981236
2026-03-24 18:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1981236
2026-03-24 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d210b3f-8592-5c95-9020-367d43e0dbf1 with scrape type 1
2026-03-24 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3d210b3f-8592-5c95-9020-367d43e0dbf1
2026-03-24 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3d210b3f-8592-5c95-9020-367d43e0dbf1
2026-03-24 18:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d210b3f-8592-5c95-9020-367d43e0dbf1, identifier: 1981236
2026-03-24 18:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/553/e3bb556de15d4168907ab704cac4440a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1981236
2026-03-24 18:31:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1981236
2026-03-24 18:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1981236 to the API
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d210b3f-8592-5c95-9020-367d43e0dbf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 109032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure Pack BlueHDi 100 S&S',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 100 S&S',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981236%27 HTTP/1.1" 200 None
2026-03-24 18:31:38 [ayvens.es] INFO: Saving data for 1981236: {'created_time': 1774377098.611335, 'last_price_update_time': 1774377098.611345, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981236') HTTP/1.1" 204 0
2026-03-24 18:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee945410>
2026-03-24 18:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e36009-44bd-51fc-ba4d-65ab7ec62b44/68e36009-44bd-51fc-ba4d-65ab7ec62b44_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F550%252F1a412819330f420abf651e181214fed9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/550/1a412819330f420abf651e181214fed9/images/large/1.jpg saved to cache
2026-03-24 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44
2026-03-24 18:31:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68e36009-44bd-51fc-ba4d-65ab7ec62b44, skipping ID generation
2026-03-24 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with scrape type 1
2026-03-24 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44 sending to next pipeline
2026-03-24 18:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 68e36009-44bd-51fc-ba4d-65ab7ec62b44, identifier: 1981228
2026-03-24 18:31:38 [ayvens.es] INFO: Found listing with ID: 1981237
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981237%27 HTTP/1.1" 200 None
2026-03-24 18:31:38 [ayvens.es] INFO: Scrape type for 1981237: 1
2026-03-24 18:31:38 [ayvens.es] INFO: Extracting data for car ID: 1981237
2026-03-24 18:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a with identifier: 1981237
2026-03-24 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a with scrape type 1
2026-03-24 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252F437ef399844f491fb92ff00d56fac5a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/437ef399844f491fb92ff00d56fac5a7/images/large/1.jpg not downloaded yet
2026-03-24 18:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1981228
2026-03-24 18:31:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1981228
2026-03-24 18:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1981228 to the API
2026-03-24 18:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/550/1a412819330f420abf651e181214fed9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco digital metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '68e36009-44bd-51fc-ba4d-65ab7ec62b44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 106281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e36009-44bd-51fc-ba4d-65ab7ec62b44/68e36009-44bd-51fc-ba4d-65ab7ec62b44_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/550/1a412819330f420abf651e181214fed9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 220 D 4MATIC',
 'transmission': 'manual',
 'trim': 'GLA 220 D 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981228%27 HTTP/1.1" 200 None
2026-03-24 18:31:39 [ayvens.es] INFO: Saving data for 1981228: {'created_time': 1774377099.21856, 'last_price_update_time': 1774377099.218571, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981228') HTTP/1.1" 204 0
2026-03-24 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/387/843044be84fc4db0a2de0e93299062e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/4af94cfca0a749cab4608ce0a618cee2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:39 [ayvens.es] INFO: Found listing with ID: 1981238
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981238%27 HTTP/1.1" 200 None
2026-03-24 18:31:39 [ayvens.es] INFO: Scrape type for 1981238: 1
2026-03-24 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1981238
2026-03-24 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1981238
2026-03-24 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a with scrape type 1
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F6238015284a64c80af0640b49e307414%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/6238015284a64c80af0640b49e307414/images/large/1.jpg not downloaded yet
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee984410>
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef2bb93-9bec-5d56-90cd-49bab6b81728/5ef2bb93-9bec-5d56-90cd-49bab6b81728_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252Fe2b441a1b03f4e9f9b26a735d54a539e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/e2b441a1b03f4e9f9b26a735d54a539e/images/large/1.jpg saved to cache
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728
2026-03-24 18:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ef2bb93-9bec-5d56-90cd-49bab6b81728, skipping ID generation
2026-03-24 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with scrape type 1
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728 sending to next pipeline
2026-03-24 18:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ef2bb93-9bec-5d56-90cd-49bab6b81728, identifier: 1981230
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6c4b90>
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46af0bb6-a44a-5bb6-9a29-265d89ed2ead/46af0bb6-a44a-5bb6-9a29-265d89ed2ead_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F553%252Fe3bb556de15d4168907ab704cac4440a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/553/e3bb556de15d4168907ab704cac4440a/images/large/1.jpg saved to cache
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead
2026-03-24 18:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead, skipping ID generation
2026-03-24 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with scrape type 1
2026-03-24 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead sending to next pipeline
2026-03-24 18:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead, identifier: 1981231
2026-03-24 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/304/0b8584d0ae8140609f3f6aad7f483ed0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1981230
2026-03-24 18:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1981230
2026-03-24 18:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1981230 to the API
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/477/e2b441a1b03f4e9f9b26a735d54a539e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ef2bb93-9bec-5d56-90cd-49bab6b81728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 91097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef2bb93-9bec-5d56-90cd-49bab6b81728/5ef2bb93-9bec-5d56-90cd-49bab6b81728_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/e2b441a1b03f4e9f9b26a735d54a539e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981230%27 HTTP/1.1" 200 None
2026-03-24 18:31:40 [ayvens.es] INFO: Saving data for 1981230: {'created_time': 1774377100.029485, 'last_price_update_time': 1774377100.0295, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981230') HTTP/1.1" 204 0
2026-03-24 18:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1981231
2026-03-24 18:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1981231
2026-03-24 18:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1981231 to the API
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/553/e3bb556de15d4168907ab704cac4440a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'gas',
 'id': '46af0bb6-a44a-5bb6-9a29-265d89ed2ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 112432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46af0bb6-a44a-5bb6-9a29-265d89ed2ead/46af0bb6-a44a-5bb6-9a29-265d89ed2ead_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/553/e3bb556de15d4168907ab704cac4440a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 66kW (90CV) Selective Pro GLP',
 'transmission': 'manual',
 'trim': '1.4 66kW (90CV) Selective Pro GLP',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981231%27 HTTP/1.1" 200 None
2026-03-24 18:31:40 [ayvens.es] INFO: Saving data for 1981231: {'created_time': 1774377100.420884, 'last_price_update_time': 1774377100.420894, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981231') HTTP/1.1" 204 0
2026-03-24 18:31:40 [ayvens.es] INFO: Found listing with ID: 1981239
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981239%27 HTTP/1.1" 200 None
2026-03-24 18:31:40 [ayvens.es] INFO: Scrape type for 1981239: 1
2026-03-24 18:31:40 [ayvens.es] INFO: Extracting data for car ID: 1981239
2026-03-24 18:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d6b67b-017c-51bc-a0ad-c6b84573b660 with identifier: 1981239
2026-03-24 18:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d6b67b-017c-51bc-a0ad-c6b84573b660 with scrape type 1
2026-03-24 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8d6b67b-017c-51bc-a0ad-c6b84573b660
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F83edd39c820c43298a3a04ceee624db5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/83edd39c820c43298a3a04ceee624db5/images/large/1.jpg not downloaded yet
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb0c450>
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d398ff69-f4fd-5d84-9c0f-c7a132afd8a9/d398ff69-f4fd-5d84-9c0f-c7a132afd8a9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252F843044be84fc4db0a2de0e93299062e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/843044be84fc4db0a2de0e93299062e3/images/large/1.jpg saved to cache
2026-03-24 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d398ff69-f4fd-5d84-9c0f-c7a132afd8a9
2026-03-24 18:31:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d398ff69-f4fd-5d84-9c0f-c7a132afd8a9, skipping ID generation
2026-03-24 18:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d398ff69-f4fd-5d84-9c0f-c7a132afd8a9 with scrape type 1
2026-03-24 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d398ff69-f4fd-5d84-9c0f-c7a132afd8a9 sending to next pipeline
2026-03-24 18:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d398ff69-f4fd-5d84-9c0f-c7a132afd8a9, identifier: 1981229
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb08750>
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8cf809-cd6a-5a05-b5fd-50120c3d2c34/de8cf809-cd6a-5a05-b5fd-50120c3d2c34_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F4af94cfca0a749cab4608ce0a618cee2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/4af94cfca0a749cab4608ce0a618cee2/images/large/1.jpg saved to cache
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34
2026-03-24 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de8cf809-cd6a-5a05-b5fd-50120c3d2c34, skipping ID generation
2026-03-24 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with scrape type 1
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34 sending to next pipeline
2026-03-24 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de8cf809-cd6a-5a05-b5fd-50120c3d2c34, identifier: 1981232
2026-03-24 18:31:41 [ayvens.es] INFO: Found listing with ID: 1981240
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981240%27 HTTP/1.1" 200 None
2026-03-24 18:31:41 [ayvens.es] INFO: Scrape type for 1981240: 1
2026-03-24 18:31:41 [ayvens.es] INFO: Extracting data for car ID: 1981240
2026-03-24 18:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a86aaac-27e0-5128-8e98-5ef86cf98b2c with identifier: 1981240
2026-03-24 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a86aaac-27e0-5128-8e98-5ef86cf98b2c with scrape type 1
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3a86aaac-27e0-5128-8e98-5ef86cf98b2c
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F978%252F86f290cef2c34e3ca9de0f1c5e00f64b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/978/86f290cef2c34e3ca9de0f1c5e00f64b/images/large/1.jpg not downloaded yet
2026-03-24 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d398ff69-f4fd-5d84-9c0f-c7a132afd8a9 with identifier: 1981229
2026-03-24 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d398ff69-f4fd-5d84-9c0f-c7a132afd8a9 with identifier: 1981229
2026-03-24 18:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d398ff69-f4fd-5d84-9c0f-c7a132afd8a9 with identifier: 1981229 to the API
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/387/843044be84fc4db0a2de0e93299062e3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd398ff69-f4fd-5d84-9c0f-c7a132afd8a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 43139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d398ff69-f4fd-5d84-9c0f-c7a132afd8a9/d398ff69-f4fd-5d84-9c0f-c7a132afd8a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/387/843044be84fc4db0a2de0e93299062e3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'transmission': 'manual',
 'trim': '1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981229%27 HTTP/1.1" 200 None
2026-03-24 18:31:41 [ayvens.es] INFO: Saving data for 1981229: {'created_time': 1774377101.428364, 'last_price_update_time': 1774377101.428373, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981229') HTTP/1.1" 204 0
2026-03-24 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1981232
2026-03-24 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1981232
2026-03-24 18:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1981232 to the API
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/635/4af94cfca0a749cab4608ce0a618cee2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Santorini black meta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de8cf809-cd6a-5a05-b5fd-50120c3d2c34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 96689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8cf809-cd6a-5a05-b5fd-50120c3d2c34/de8cf809-cd6a-5a05-b5fd-50120c3d2c34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/4af94cfca0a749cab4608ce0a618cee2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 SE AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 SE AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981232%27 HTTP/1.1" 200 None
2026-03-24 18:31:41 [ayvens.es] INFO: Saving data for 1981232: {'created_time': 1774377101.752185, 'last_price_update_time': 1774377101.752195, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981232') HTTP/1.1" 204 0
2026-03-24 18:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee986910>
2026-03-24 18:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e60203a-5529-5bef-bfe2-b5f80008f875/3e60203a-5529-5bef-bfe2-b5f80008f875_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F304%252F0b8584d0ae8140609f3f6aad7f483ed0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/304/0b8584d0ae8140609f3f6aad7f483ed0/images/large/1.jpg saved to cache
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e60203a-5529-5bef-bfe2-b5f80008f875
2026-03-24 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e60203a-5529-5bef-bfe2-b5f80008f875, skipping ID generation
2026-03-24 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e60203a-5529-5bef-bfe2-b5f80008f875 with scrape type 1
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e60203a-5529-5bef-bfe2-b5f80008f875 sending to next pipeline
2026-03-24 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e60203a-5529-5bef-bfe2-b5f80008f875, identifier: 1981233
2026-03-24 18:31:41 [ayvens.es] INFO: Found listing with ID: 1981241
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981241%27 HTTP/1.1" 200 None
2026-03-24 18:31:41 [ayvens.es] INFO: Scrape type for 1981241: 1
2026-03-24 18:31:41 [ayvens.es] INFO: Extracting data for car ID: 1981241
2026-03-24 18:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d1963a-daeb-5d10-a888-f9c68c3459da with identifier: 1981241
2026-03-24 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d1963a-daeb-5d10-a888-f9c68c3459da with scrape type 1
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 54d1963a-daeb-5d10-a888-f9c68c3459da
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F882%252F7c7483a6e8a34a869c55fc42267cca2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/882/7c7483a6e8a34a869c55fc42267cca2c/images/large/1.jpg not downloaded yet
2026-03-24 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e60203a-5529-5bef-bfe2-b5f80008f875 with identifier: 1981233
2026-03-24 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e60203a-5529-5bef-bfe2-b5f80008f875 with identifier: 1981233
2026-03-24 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e60203a-5529-5bef-bfe2-b5f80008f875 with identifier: 1981233 to the API
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/304/0b8584d0ae8140609f3f6aad7f483ed0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Eiger grey metallic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e60203a-5529-5bef-bfe2-b5f80008f875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 43420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e60203a-5529-5bef-bfe2-b5f80008f875/3e60203a-5529-5bef-bfe2-b5f80008f875_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/304/0b8584d0ae8140609f3f6aad7f483ed0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981233%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [ayvens.es] INFO: Saving data for 1981233: {'created_time': 1774377102.303637, 'last_price_update_time': 1774377102.303649, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981233') HTTP/1.1" 204 0
2026-03-24 18:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/241/cec0284a02314ade8a95a72f3afaa6f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:42 [ayvens.es] INFO: Found listing with ID: 1981242
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981242%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [ayvens.es] INFO: Scrape type for 1981242: 1
2026-03-24 18:31:42 [ayvens.es] INFO: Extracting data for car ID: 1981242
2026-03-24 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae4a6795-0572-5519-89ed-ab6cb85b79b1 with identifier: 1981242
2026-03-24 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae4a6795-0572-5519-89ed-ab6cb85b79b1 with scrape type 1
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ae4a6795-0572-5519-89ed-ab6cb85b79b1
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F642%252F2d7e91f2204b43fc820544249cf84c39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/642/2d7e91f2204b43fc820544249cf84c39/images/large/1.jpg not downloaded yet
2026-03-24 18:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/645/8e9ab07712df45fc8aff84a3d87dbe45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/721/437ef399844f491fb92ff00d56fac5a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:42 [ayvens.es] INFO: Found listing with ID: 1981243
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981243%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [ayvens.es] INFO: Scrape type for 1981243: 1
2026-03-24 18:31:42 [ayvens.es] INFO: Extracting data for car ID: 1981243
2026-03-24 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ba8449d-55dc-5f6f-b793-db53148b779f with identifier: 1981243
2026-03-24 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ba8449d-55dc-5f6f-b793-db53148b779f with scrape type 1
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ba8449d-55dc-5f6f-b793-db53148b779f
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F291%252F472917257a6e4aff81cb97863140f00f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/291/472917257a6e4aff81cb97863140f00f/images/large/1.jpg not downloaded yet
2026-03-24 18:31:42 [ayvens.es] INFO: Found listing with ID: 1981244
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981244%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [ayvens.es] INFO: Scrape type for 1981244: 1
2026-03-24 18:31:42 [ayvens.es] INFO: Extracting data for car ID: 1981244
2026-03-24 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8341561-849a-5697-8112-81f88b2ce4fd with identifier: 1981244
2026-03-24 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8341561-849a-5697-8112-81f88b2ce4fd with scrape type 1
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8341561-849a-5697-8112-81f88b2ce4fd
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F147%252F8a0cdd40af93453bababa297d9a1c7a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/147/8a0cdd40af93453bababa297d9a1c7a1/images/large/1.jpg not downloaded yet
2026-03-24 18:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/426/83edd39c820c43298a3a04ceee624db5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:42 [ayvens.es] INFO: Found listing with ID: 1981245
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981245%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [ayvens.es] INFO: Scrape type for 1981245: 1
2026-03-24 18:31:42 [ayvens.es] INFO: Extracting data for car ID: 1981245
2026-03-24 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1981245
2026-03-24 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2330bc70-d639-5317-b4fc-f1d497ca14c3 with scrape type 1
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2330bc70-d639-5317-b4fc-f1d497ca14c3
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252F21ce14f572fd499f837bdcf2b4937c95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/21ce14f572fd499f837bdcf2b4937c95/images/large/1.jpg not downloaded yet
2026-03-24 18:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb0ba90>
2026-03-24 18:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb5b85f-38c5-58eb-acec-4dcbdcd865d6/2bb5b85f-38c5-58eb-acec-4dcbdcd865d6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252Fcec0284a02314ade8a95a72f3afaa6f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/cec0284a02314ade8a95a72f3afaa6f5/images/large/1.jpg saved to cache
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6
2026-03-24 18:31:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6, skipping ID generation
2026-03-24 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with scrape type 1
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 sending to next pipeline
2026-03-24 18:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6, identifier: 1981234
2026-03-24 18:31:42 [ayvens.es] INFO: Found listing with ID: 1981246
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981246%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [ayvens.es] INFO: Scrape type for 1981246: 1
2026-03-24 18:31:42 [ayvens.es] INFO: Extracting data for car ID: 1981246
2026-03-24 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1981246
2026-03-24 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499510cd-370c-594f-aac2-a356193afb70 with scrape type 1
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 499510cd-370c-594f-aac2-a356193afb70
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F269%252F3810f86903c940e19924908d35a0aa54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/269/3810f86903c940e19924908d35a0aa54/images/large/1.jpg not downloaded yet
2026-03-24 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1981234
2026-03-24 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1981234
2026-03-24 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1981234 to the API
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/241/cec0284a02314ade8a95a72f3afaa6f5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2bb5b85f-38c5-58eb-acec-4dcbdcd865d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'CEED',
 'odometer': 174913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb5b85f-38c5-58eb-acec-4dcbdcd865d6/2bb5b85f-38c5-58eb-acec-4dcbdcd865d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/241/cec0284a02314ade8a95a72f3afaa6f5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA CEED Tourer 1.6 MHEV iMT 100kW Drive',
 'transmission': 'manual',
 'trim': 'Tourer 1.6 MHEV iMT 100kW Drive',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981234%27 HTTP/1.1" 200 None
2026-03-24 18:31:42 [ayvens.es] INFO: Saving data for 1981234: {'created_time': 1774377102.989483, 'last_price_update_time': 1774377102.989493, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981234') HTTP/1.1" 204 0
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee889710>
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2983285f-b6e9-519c-b21d-2d9dce5c6475/2983285f-b6e9-519c-b21d-2d9dce5c6475_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252F8e9ab07712df45fc8aff84a3d87dbe45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/8e9ab07712df45fc8aff84a3d87dbe45/images/large/1.jpg saved to cache
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2983285f-b6e9-519c-b21d-2d9dce5c6475
2026-03-24 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2983285f-b6e9-519c-b21d-2d9dce5c6475, skipping ID generation
2026-03-24 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2983285f-b6e9-519c-b21d-2d9dce5c6475 with scrape type 1
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2983285f-b6e9-519c-b21d-2d9dce5c6475 sending to next pipeline
2026-03-24 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2983285f-b6e9-519c-b21d-2d9dce5c6475, identifier: 1981235
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb60590>
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a/7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252F437ef399844f491fb92ff00d56fac5a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/437ef399844f491fb92ff00d56fac5a7/images/large/1.jpg saved to cache
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a
2026-03-24 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a, skipping ID generation
2026-03-24 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a with scrape type 1
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a sending to next pipeline
2026-03-24 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a, identifier: 1981237
2026-03-24 18:31:43 [ayvens.es] INFO: Found listing with ID: 1981247
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981247%27 HTTP/1.1" 200 None
2026-03-24 18:31:43 [ayvens.es] INFO: Scrape type for 1981247: 1
2026-03-24 18:31:43 [ayvens.es] INFO: Extracting data for car ID: 1981247
2026-03-24 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1981247
2026-03-24 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with scrape type 1
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fe9fe7235683044699e9763ee42e00c69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/e9fe7235683044699e9763ee42e00c69/images/large/1.jpg not downloaded yet
2026-03-24 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1981235
2026-03-24 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1981235
2026-03-24 18:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1981235 to the API
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/645/8e9ab07712df45fc8aff84a3d87dbe45/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata perla moondust',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2983285f-b6e9-519c-b21d-2d9dce5c6475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 114790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2983285f-b6e9-519c-b21d-2d9dce5c6475/2983285f-b6e9-519c-b21d-2d9dce5c6475_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/645/8e9ab07712df45fc8aff84a3d87dbe45/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981235%27 HTTP/1.1" 200 None
2026-03-24 18:31:43 [ayvens.es] INFO: Saving data for 1981235: {'created_time': 1774377103.664498, 'last_price_update_time': 1774377103.664509, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981235') HTTP/1.1" 204 0
2026-03-24 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a with identifier: 1981237
2026-03-24 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a with identifier: 1981237
2026-03-24 18:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a with identifier: 1981237 to the API
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/721/437ef399844f491fb92ff00d56fac5a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 90095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a/7b1e23f6-8f24-590d-a2fb-3c69cb0bd58a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/721/437ef399844f491fb92ff00d56fac5a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981237%27 HTTP/1.1" 200 None
2026-03-24 18:31:43 [ayvens.es] INFO: Saving data for 1981237: {'created_time': 1774377103.948458, 'last_price_update_time': 1774377103.948468, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981237') HTTP/1.1" 204 0
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee31c50>
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d6b67b-017c-51bc-a0ad-c6b84573b660/c8d6b67b-017c-51bc-a0ad-c6b84573b660_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F83edd39c820c43298a3a04ceee624db5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/83edd39c820c43298a3a04ceee624db5/images/large/1.jpg saved to cache
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8d6b67b-017c-51bc-a0ad-c6b84573b660
2026-03-24 18:31:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8d6b67b-017c-51bc-a0ad-c6b84573b660, skipping ID generation
2026-03-24 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d6b67b-017c-51bc-a0ad-c6b84573b660 with scrape type 1
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8d6b67b-017c-51bc-a0ad-c6b84573b660 sending to next pipeline
2026-03-24 18:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8d6b67b-017c-51bc-a0ad-c6b84573b660, identifier: 1981239
2026-03-24 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/882/7c7483a6e8a34a869c55fc42267cca2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:44 [ayvens.es] INFO: Found listing with ID: 1981248
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981248%27 HTTP/1.1" 200 None
2026-03-24 18:31:44 [ayvens.es] INFO: Scrape type for 1981248: 1
2026-03-24 18:31:44 [ayvens.es] INFO: Extracting data for car ID: 1981248
2026-03-24 18:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1981248
2026-03-24 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaa366d-6018-51ca-8a0c-131028ccd16f with scrape type 1
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9aaa366d-6018-51ca-8a0c-131028ccd16f
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Fe23c77b4d9d144cbaa12ad164dca1204%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/e23c77b4d9d144cbaa12ad164dca1204/images/large/1.jpg not downloaded yet
2026-03-24 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8d6b67b-017c-51bc-a0ad-c6b84573b660 with identifier: 1981239
2026-03-24 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8d6b67b-017c-51bc-a0ad-c6b84573b660 with identifier: 1981239
2026-03-24 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c8d6b67b-017c-51bc-a0ad-c6b84573b660 with identifier: 1981239 to the API
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/426/83edd39c820c43298a3a04ceee624db5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c8d6b67b-017c-51bc-a0ad-c6b84573b660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 89843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d6b67b-017c-51bc-a0ad-c6b84573b660/c8d6b67b-017c-51bc-a0ad-c6b84573b660_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/426/83edd39c820c43298a3a04ceee624db5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981239%27 HTTP/1.1" 200 None
2026-03-24 18:31:44 [ayvens.es] INFO: Saving data for 1981239: {'created_time': 1774377104.526751, 'last_price_update_time': 1774377104.526761, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981239') HTTP/1.1" 204 0
2026-03-24 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/6238015284a64c80af0640b49e307414/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/642/2d7e91f2204b43fc820544249cf84c39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/978/86f290cef2c34e3ca9de0f1c5e00f64b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:44 [ayvens.es] INFO: Found listing with ID: 1981249
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981249%27 HTTP/1.1" 200 None
2026-03-24 18:31:44 [ayvens.es] INFO: Scrape type for 1981249: 1
2026-03-24 18:31:44 [ayvens.es] INFO: Extracting data for car ID: 1981249
2026-03-24 18:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be1a58c5-36cf-5c46-8063-c32738671cf0 with identifier: 1981249
2026-03-24 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be1a58c5-36cf-5c46-8063-c32738671cf0 with scrape type 1
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item be1a58c5-36cf-5c46-8063-c32738671cf0
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F253%252F4b4c2de51d0e4fd58bd8c5f258a44715%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/253/4b4c2de51d0e4fd58bd8c5f258a44715/images/large/1.jpg not downloaded yet
2026-03-24 18:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1e5310>
2026-03-24 18:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d1963a-daeb-5d10-a888-f9c68c3459da/54d1963a-daeb-5d10-a888-f9c68c3459da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F882%252F7c7483a6e8a34a869c55fc42267cca2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/882/7c7483a6e8a34a869c55fc42267cca2c/images/large/1.jpg saved to cache
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54d1963a-daeb-5d10-a888-f9c68c3459da
2026-03-24 18:31:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54d1963a-daeb-5d10-a888-f9c68c3459da, skipping ID generation
2026-03-24 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d1963a-daeb-5d10-a888-f9c68c3459da with scrape type 1
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54d1963a-daeb-5d10-a888-f9c68c3459da sending to next pipeline
2026-03-24 18:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 54d1963a-daeb-5d10-a888-f9c68c3459da, identifier: 1981241
2026-03-24 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/147/8a0cdd40af93453bababa297d9a1c7a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:44 [ayvens.es] INFO: Found listing with ID: 1981250
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981250%27 HTTP/1.1" 200 None
2026-03-24 18:31:44 [ayvens.es] INFO: Scrape type for 1981250: 1
2026-03-24 18:31:44 [ayvens.es] INFO: Extracting data for car ID: 1981250
2026-03-24 18:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1981250
2026-03-24 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100b87c0-2dd8-5052-895b-f7e864cf4f15 with scrape type 1
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 100b87c0-2dd8-5052-895b-f7e864cf4f15
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F898%252Ffc39cb6b58eb4a75a4fb909519a2d059%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/898/fc39cb6b58eb4a75a4fb909519a2d059/images/large/1.jpg not downloaded yet
2026-03-24 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 54d1963a-daeb-5d10-a888-f9c68c3459da with identifier: 1981241
2026-03-24 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 54d1963a-daeb-5d10-a888-f9c68c3459da with identifier: 1981241
2026-03-24 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 54d1963a-daeb-5d10-a888-f9c68c3459da with identifier: 1981241 to the API
2026-03-24 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/882/7c7483a6e8a34a869c55fc42267cca2c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '54d1963a-daeb-5d10-a888-f9c68c3459da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 4',
 'odometer': 30844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d1963a-daeb-5d10-a888-f9c68c3459da/54d1963a-daeb-5d10-a888-f9c68c3459da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/882/7c7483a6e8a34a869c55fc42267cca2c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW SERIES 4 440i',
 'transmission': 'manual',
 'trim': '440i',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981241%27 HTTP/1.1" 200 None
2026-03-24 18:31:45 [ayvens.es] INFO: Saving data for 1981241: {'created_time': 1774377105.178606, 'last_price_update_time': 1774377105.178618, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981241') HTTP/1.1" 204 0
2026-03-24 18:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/291/472917257a6e4aff81cb97863140f00f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/774/21ce14f572fd499f837bdcf2b4937c95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:45 [ayvens.es] INFO: Found listing with ID: 1981251
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981251%27 HTTP/1.1" 200 None
2026-03-24 18:31:45 [ayvens.es] INFO: Scrape type for 1981251: 1
2026-03-24 18:31:45 [ayvens.es] INFO: Extracting data for car ID: 1981251
2026-03-24 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19e0639a-9343-5bcd-9bbc-ffccc80f0af4 with identifier: 1981251
2026-03-24 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e0639a-9343-5bcd-9bbc-ffccc80f0af4 with scrape type 1
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 19e0639a-9343-5bcd-9bbc-ffccc80f0af4
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F8029f8fcf37f4d6e9b040816a763be7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/8029f8fcf37f4d6e9b040816a763be7b/images/large/1.jpg not downloaded yet
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb0b610>
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_379e40c5-32d3-5c8e-bd40-5caf86c2734a/379e40c5-32d3-5c8e-bd40-5caf86c2734a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F6238015284a64c80af0640b49e307414%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/6238015284a64c80af0640b49e307414/images/large/1.jpg saved to cache
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a
2026-03-24 18:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 379e40c5-32d3-5c8e-bd40-5caf86c2734a, skipping ID generation
2026-03-24 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a with scrape type 1
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a sending to next pipeline
2026-03-24 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 379e40c5-32d3-5c8e-bd40-5caf86c2734a, identifier: 1981238
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eec95190>
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4a6795-0572-5519-89ed-ab6cb85b79b1/ae4a6795-0572-5519-89ed-ab6cb85b79b1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F642%252F2d7e91f2204b43fc820544249cf84c39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/642/2d7e91f2204b43fc820544249cf84c39/images/large/1.jpg saved to cache
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae4a6795-0572-5519-89ed-ab6cb85b79b1
2026-03-24 18:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae4a6795-0572-5519-89ed-ab6cb85b79b1, skipping ID generation
2026-03-24 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae4a6795-0572-5519-89ed-ab6cb85b79b1 with scrape type 1
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae4a6795-0572-5519-89ed-ab6cb85b79b1 sending to next pipeline
2026-03-24 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ae4a6795-0572-5519-89ed-ab6cb85b79b1, identifier: 1981242
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee32750>
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a86aaac-27e0-5128-8e98-5ef86cf98b2c/3a86aaac-27e0-5128-8e98-5ef86cf98b2c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F978%252F86f290cef2c34e3ca9de0f1c5e00f64b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/978/86f290cef2c34e3ca9de0f1c5e00f64b/images/large/1.jpg saved to cache
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a86aaac-27e0-5128-8e98-5ef86cf98b2c
2026-03-24 18:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a86aaac-27e0-5128-8e98-5ef86cf98b2c, skipping ID generation
2026-03-24 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a86aaac-27e0-5128-8e98-5ef86cf98b2c with scrape type 1
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a86aaac-27e0-5128-8e98-5ef86cf98b2c sending to next pipeline
2026-03-24 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3a86aaac-27e0-5128-8e98-5ef86cf98b2c, identifier: 1981240
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeca8910>
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8341561-849a-5697-8112-81f88b2ce4fd/c8341561-849a-5697-8112-81f88b2ce4fd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F147%252F8a0cdd40af93453bababa297d9a1c7a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/147/8a0cdd40af93453bababa297d9a1c7a1/images/large/1.jpg saved to cache
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8341561-849a-5697-8112-81f88b2ce4fd
2026-03-24 18:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8341561-849a-5697-8112-81f88b2ce4fd, skipping ID generation
2026-03-24 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8341561-849a-5697-8112-81f88b2ce4fd with scrape type 1
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8341561-849a-5697-8112-81f88b2ce4fd sending to next pipeline
2026-03-24 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8341561-849a-5697-8112-81f88b2ce4fd, identifier: 1981244
2026-03-24 18:31:45 [ayvens.es] INFO: Found listing with ID: 1981252
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981252%27 HTTP/1.1" 200 None
2026-03-24 18:31:45 [ayvens.es] INFO: Scrape type for 1981252: 1
2026-03-24 18:31:45 [ayvens.es] INFO: Extracting data for car ID: 1981252
2026-03-24 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef18afa-808d-50b4-958f-6d5617c1c869 with identifier: 1981252
2026-03-24 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef18afa-808d-50b4-958f-6d5617c1c869 with scrape type 1
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ef18afa-808d-50b4-958f-6d5617c1c869
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F583%252F5d419d418f9c4b8c998dc9c4a9b21881%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/583/5d419d418f9c4b8c998dc9c4a9b21881/images/large/1.jpg not downloaded yet
2026-03-24 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1981238
2026-03-24 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1981238
2026-03-24 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1981238 to the API
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/6238015284a64c80af0640b49e307414/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'gas',
 'id': '379e40c5-32d3-5c8e-bd40-5caf86c2734a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 69751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_379e40c5-32d3-5c8e-bd40-5caf86c2734a/379e40c5-32d3-5c8e-bd40-5caf86c2734a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/6238015284a64c80af0640b49e307414/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO Comfort 74kW (100CV) ECO-G',
 'transmission': 'manual',
 'trim': 'Comfort 74kW (100CV) ECO-G',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981238%27 HTTP/1.1" 200 None
2026-03-24 18:31:46 [ayvens.es] INFO: Saving data for 1981238: {'created_time': 1774377106.204105, 'last_price_update_time': 1774377106.204116, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981238') HTTP/1.1" 204 0
2026-03-24 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ae4a6795-0572-5519-89ed-ab6cb85b79b1 with identifier: 1981242
2026-03-24 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ae4a6795-0572-5519-89ed-ab6cb85b79b1 with identifier: 1981242
2026-03-24 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ae4a6795-0572-5519-89ed-ab6cb85b79b1 with identifier: 1981242 to the API
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/642/2d7e91f2204b43fc820544249cf84c39/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ae4a6795-0572-5519-89ed-ab6cb85b79b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 36057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4a6795-0572-5519-89ed-ab6cb85b79b1/ae4a6795-0572-5519-89ed-ab6cb85b79b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/642/2d7e91f2204b43fc820544249cf84c39/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost 74kW Trend S/S 5p',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 74kW Trend S/S 5p',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981242%27 HTTP/1.1" 200 None
2026-03-24 18:31:46 [ayvens.es] INFO: Saving data for 1981242: {'created_time': 1774377106.495102, 'last_price_update_time': 1774377106.495112, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981242') HTTP/1.1" 204 0
2026-03-24 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3a86aaac-27e0-5128-8e98-5ef86cf98b2c with identifier: 1981240
2026-03-24 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3a86aaac-27e0-5128-8e98-5ef86cf98b2c with identifier: 1981240
2026-03-24 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3a86aaac-27e0-5128-8e98-5ef86cf98b2c with identifier: 1981240 to the API
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/978/86f290cef2c34e3ca9de0f1c5e00f64b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a86aaac-27e0-5128-8e98-5ef86cf98b2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 77981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a86aaac-27e0-5128-8e98-5ef86cf98b2c/3a86aaac-27e0-5128-8e98-5ef86cf98b2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/978/86f290cef2c34e3ca9de0f1c5e00f64b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 BlueHdi 110 S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHdi 110 S&S Feel Pack',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981240%27 HTTP/1.1" 200 None
2026-03-24 18:31:46 [ayvens.es] INFO: Saving data for 1981240: {'created_time': 1774377106.812914, 'last_price_update_time': 1774377106.812926, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981240') HTTP/1.1" 204 0
2026-03-24 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8341561-849a-5697-8112-81f88b2ce4fd with identifier: 1981244
2026-03-24 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8341561-849a-5697-8112-81f88b2ce4fd with identifier: 1981244
2026-03-24 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c8341561-849a-5697-8112-81f88b2ce4fd with identifier: 1981244 to the API
2026-03-24 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/147/8a0cdd40af93453bababa297d9a1c7a1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Firenze red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c8341561-849a-5697-8112-81f88b2ce4fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR',
 'odometer': 81843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8341561-849a-5697-8112-81f88b2ce4fd/c8341561-849a-5697-8112-81f88b2ce4fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/147/8a0cdd40af93453bababa297d9a1c7a1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER VELAR (O) 2.0 D180 132kW R-Dynamic S 4WD '
          'Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D180 132kW R-Dynamic S 4WD Auto',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981244%27 HTTP/1.1" 200 None
2026-03-24 18:31:47 [ayvens.es] INFO: Saving data for 1981244: {'created_time': 1774377107.131665, 'last_price_update_time': 1774377107.131675, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981244') HTTP/1.1" 204 0
2026-03-24 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/269/3810f86903c940e19924908d35a0aa54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:47 [ayvens.es] INFO: Found listing with ID: 1981253
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981253%27 HTTP/1.1" 200 None
2026-03-24 18:31:47 [ayvens.es] INFO: Scrape type for 1981253: 1
2026-03-24 18:31:47 [ayvens.es] INFO: Extracting data for car ID: 1981253
2026-03-24 18:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1981253
2026-03-24 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0991cd93-117d-52a3-8e8d-1211eb28962f with scrape type 1
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0991cd93-117d-52a3-8e8d-1211eb28962f
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252Fe8427a221ad44c06aff0e4efb30bdf9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/e8427a221ad44c06aff0e4efb30bdf9b/images/large/1.jpg not downloaded yet
2026-03-24 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/192/e9fe7235683044699e9763ee42e00c69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee711150>
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ba8449d-55dc-5f6f-b793-db53148b779f/8ba8449d-55dc-5f6f-b793-db53148b779f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F291%252F472917257a6e4aff81cb97863140f00f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/291/472917257a6e4aff81cb97863140f00f/images/large/1.jpg saved to cache
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ba8449d-55dc-5f6f-b793-db53148b779f
2026-03-24 18:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ba8449d-55dc-5f6f-b793-db53148b779f, skipping ID generation
2026-03-24 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ba8449d-55dc-5f6f-b793-db53148b779f with scrape type 1
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ba8449d-55dc-5f6f-b793-db53148b779f sending to next pipeline
2026-03-24 18:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ba8449d-55dc-5f6f-b793-db53148b779f, identifier: 1981243
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea95290>
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2330bc70-d639-5317-b4fc-f1d497ca14c3/2330bc70-d639-5317-b4fc-f1d497ca14c3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252F21ce14f572fd499f837bdcf2b4937c95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/21ce14f572fd499f837bdcf2b4937c95/images/large/1.jpg saved to cache
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2330bc70-d639-5317-b4fc-f1d497ca14c3
2026-03-24 18:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2330bc70-d639-5317-b4fc-f1d497ca14c3, skipping ID generation
2026-03-24 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2330bc70-d639-5317-b4fc-f1d497ca14c3 with scrape type 1
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2330bc70-d639-5317-b4fc-f1d497ca14c3 sending to next pipeline
2026-03-24 18:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2330bc70-d639-5317-b4fc-f1d497ca14c3, identifier: 1981245
2026-03-24 18:31:47 [ayvens.es] INFO: Found listing with ID: 1981254
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981254%27 HTTP/1.1" 200 None
2026-03-24 18:31:47 [ayvens.es] INFO: Scrape type for 1981254: 1
2026-03-24 18:31:47 [ayvens.es] INFO: Extracting data for car ID: 1981254
2026-03-24 18:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1981254
2026-03-24 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with scrape type 1
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F0c7844c9fa1c49afae902d3341d979cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/0c7844c9fa1c49afae902d3341d979cb/images/large/1.jpg not downloaded yet
2026-03-24 18:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ba8449d-55dc-5f6f-b793-db53148b779f with identifier: 1981243
2026-03-24 18:31:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ba8449d-55dc-5f6f-b793-db53148b779f with identifier: 1981243
2026-03-24 18:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ba8449d-55dc-5f6f-b793-db53148b779f with identifier: 1981243 to the API
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/291/472917257a6e4aff81cb97863140f00f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blanco alpino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ba8449d-55dc-5f6f-b793-db53148b779f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA',
 'odometer': 188187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ba8449d-55dc-5f6f-b793-db53148b779f/8ba8449d-55dc-5f6f-b793-db53148b779f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/291/472917257a6e4aff81cb97863140f00f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA 1.5D DVC 77kW (105CV) Astra',
 'transmission': 'manual',
 'trim': '1.5D DVC 77kW (105CV) Astra',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981243%27 HTTP/1.1" 200 None
2026-03-24 18:31:47 [ayvens.es] INFO: Saving data for 1981243: {'created_time': 1774377107.945112, 'last_price_update_time': 1774377107.945121, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981243') HTTP/1.1" 204 0
2026-03-24 18:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1981245
2026-03-24 18:31:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1981245
2026-03-24 18:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1981245 to the API
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/774/21ce14f572fd499f837bdcf2b4937c95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul encre',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2330bc70-d639-5317-b4fc-f1d497ca14c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 91489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2330bc70-d639-5317-b4fc-f1d497ca14c3/2330bc70-d639-5317-b4fc-f1d497ca14c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/774/21ce14f572fd499f837bdcf2b4937c95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981245%27 HTTP/1.1" 200 None
2026-03-24 18:31:48 [ayvens.es] INFO: Saving data for 1981245: {'created_time': 1774377108.244351, 'last_price_update_time': 1774377108.244362, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981245') HTTP/1.1" 204 0
2026-03-24 18:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/253/4b4c2de51d0e4fd58bd8c5f258a44715/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/675/e23c77b4d9d144cbaa12ad164dca1204/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:48 [ayvens.es] INFO: Found listing with ID: 1981255
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981255%27 HTTP/1.1" 200 None
2026-03-24 18:31:48 [ayvens.es] INFO: Scrape type for 1981255: 1
2026-03-24 18:31:48 [ayvens.es] INFO: Extracting data for car ID: 1981255
2026-03-24 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1981255
2026-03-24 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e6a504-dd90-5409-9225-60fdd1e09db0 with scrape type 1
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9e6a504-dd90-5409-9225-60fdd1e09db0
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F314%252F8d85d2bd450445fea5e480af4fa1130c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/314/8d85d2bd450445fea5e480af4fa1130c/images/large/1.jpg not downloaded yet
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1ea710>
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_499510cd-370c-594f-aac2-a356193afb70/499510cd-370c-594f-aac2-a356193afb70_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F269%252F3810f86903c940e19924908d35a0aa54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/269/3810f86903c940e19924908d35a0aa54/images/large/1.jpg saved to cache
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 499510cd-370c-594f-aac2-a356193afb70
2026-03-24 18:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 499510cd-370c-594f-aac2-a356193afb70, skipping ID generation
2026-03-24 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499510cd-370c-594f-aac2-a356193afb70 with scrape type 1
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 499510cd-370c-594f-aac2-a356193afb70 sending to next pipeline
2026-03-24 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 499510cd-370c-594f-aac2-a356193afb70, identifier: 1981246
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7cd1d0>
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b7bfcb-57b8-56da-9573-6c3e840a72a4/94b7bfcb-57b8-56da-9573-6c3e840a72a4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fe9fe7235683044699e9763ee42e00c69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/e9fe7235683044699e9763ee42e00c69/images/large/1.jpg saved to cache
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4
2026-03-24 18:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b7bfcb-57b8-56da-9573-6c3e840a72a4, skipping ID generation
2026-03-24 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with scrape type 1
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4 sending to next pipeline
2026-03-24 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94b7bfcb-57b8-56da-9573-6c3e840a72a4, identifier: 1981247
2026-03-24 18:31:48 [ayvens.es] INFO: Found listing with ID: 1981256
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981256%27 HTTP/1.1" 200 None
2026-03-24 18:31:48 [ayvens.es] INFO: Scrape type for 1981256: 1
2026-03-24 18:31:48 [ayvens.es] INFO: Extracting data for car ID: 1981256
2026-03-24 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfa67beb-3875-567a-ac77-b54abb0e00da with identifier: 1981256
2026-03-24 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa67beb-3875-567a-ac77-b54abb0e00da with scrape type 1
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dfa67beb-3875-567a-ac77-b54abb0e00da
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F399%252Fb90ba04baf97479e9b2a3d061c497e6c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/399/b90ba04baf97479e9b2a3d061c497e6c/images/large/1.jpg not downloaded yet
2026-03-24 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1981246
2026-03-24 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1981246
2026-03-24 18:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1981246 to the API
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/269/3810f86903c940e19924908d35a0aa54/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Cristal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '499510cd-370c-594f-aac2-a356193afb70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 87333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499510cd-370c-594f-aac2-a356193afb70/499510cd-370c-594f-aac2-a356193afb70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/269/3810f86903c940e19924908d35a0aa54/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 Auto Bastille +',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 Auto Bastille +',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981246%27 HTTP/1.1" 200 None
2026-03-24 18:31:48 [ayvens.es] INFO: Saving data for 1981246: {'created_time': 1774377108.929319, 'last_price_update_time': 1774377108.929329, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981246') HTTP/1.1" 204 0
2026-03-24 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1981247
2026-03-24 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1981247
2026-03-24 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1981247 to the API
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/192/e9fe7235683044699e9763ee42e00c69/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '94b7bfcb-57b8-56da-9573-6c3e840a72a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 114521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b7bfcb-57b8-56da-9573-6c3e840a72a4/94b7bfcb-57b8-56da-9573-6c3e840a72a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/192/e9fe7235683044699e9763ee42e00c69/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 1.0 TGDI Maxx 4X2',
 'transmission': 'manual',
 'trim': '1.0 TGDI Maxx 4X2',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981247%27 HTTP/1.1" 200 None
2026-03-24 18:31:49 [ayvens.es] INFO: Saving data for 1981247: {'created_time': 1774377109.245546, 'last_price_update_time': 1774377109.245556, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981247') HTTP/1.1" 204 0
2026-03-24 18:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/664/8029f8fcf37f4d6e9b040816a763be7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/898/fc39cb6b58eb4a75a4fb909519a2d059/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:49 [ayvens.es] INFO: Found listing with ID: 1981257
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981257%27 HTTP/1.1" 200 None
2026-03-24 18:31:49 [ayvens.es] INFO: Scrape type for 1981257: 1
2026-03-24 18:31:49 [ayvens.es] INFO: Extracting data for car ID: 1981257
2026-03-24 18:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fabcf9a1-7d50-5310-8b85-2c600fd6a2c7 with identifier: 1981257
2026-03-24 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fabcf9a1-7d50-5310-8b85-2c600fd6a2c7 with scrape type 1
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fabcf9a1-7d50-5310-8b85-2c600fd6a2c7
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F181%252Fe51bd0ab7f3a4d25a008fa8714344e4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/181/e51bd0ab7f3a4d25a008fa8714344e4d/images/large/1.jpg not downloaded yet
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eec97590>
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be1a58c5-36cf-5c46-8063-c32738671cf0/be1a58c5-36cf-5c46-8063-c32738671cf0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F253%252F4b4c2de51d0e4fd58bd8c5f258a44715%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/253/4b4c2de51d0e4fd58bd8c5f258a44715/images/large/1.jpg saved to cache
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be1a58c5-36cf-5c46-8063-c32738671cf0
2026-03-24 18:31:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be1a58c5-36cf-5c46-8063-c32738671cf0, skipping ID generation
2026-03-24 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be1a58c5-36cf-5c46-8063-c32738671cf0 with scrape type 1
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be1a58c5-36cf-5c46-8063-c32738671cf0 sending to next pipeline
2026-03-24 18:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: be1a58c5-36cf-5c46-8063-c32738671cf0, identifier: 1981249
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8c9190>
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaa366d-6018-51ca-8a0c-131028ccd16f/9aaa366d-6018-51ca-8a0c-131028ccd16f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Fe23c77b4d9d144cbaa12ad164dca1204%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/e23c77b4d9d144cbaa12ad164dca1204/images/large/1.jpg saved to cache
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9aaa366d-6018-51ca-8a0c-131028ccd16f
2026-03-24 18:31:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9aaa366d-6018-51ca-8a0c-131028ccd16f, skipping ID generation
2026-03-24 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaa366d-6018-51ca-8a0c-131028ccd16f with scrape type 1
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9aaa366d-6018-51ca-8a0c-131028ccd16f sending to next pipeline
2026-03-24 18:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9aaa366d-6018-51ca-8a0c-131028ccd16f, identifier: 1981248
2026-03-24 18:31:49 [ayvens.es] INFO: Found listing with ID: 1981258
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981258%27 HTTP/1.1" 200 None
2026-03-24 18:31:49 [ayvens.es] INFO: Scrape type for 1981258: 1
2026-03-24 18:31:49 [ayvens.es] INFO: Extracting data for car ID: 1981258
2026-03-24 18:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1981258
2026-03-24 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with scrape type 1
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252F4e7f331933ee4421a6b58fadf4db3c21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/4e7f331933ee4421a6b58fadf4db3c21/images/large/1.jpg not downloaded yet
2026-03-24 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: be1a58c5-36cf-5c46-8063-c32738671cf0 with identifier: 1981249
2026-03-24 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: be1a58c5-36cf-5c46-8063-c32738671cf0 with identifier: 1981249
2026-03-24 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: be1a58c5-36cf-5c46-8063-c32738671cf0 with identifier: 1981249 to the API
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/253/4b4c2de51d0e4fd58bd8c5f258a44715/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'be1a58c5-36cf-5c46-8063-c32738671cf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-MAX',
 'odometer': 155396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be1a58c5-36cf-5c46-8063-c32738671cf0/be1a58c5-36cf-5c46-8063-c32738671cf0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/253/4b4c2de51d0e4fd58bd8c5f258a44715/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD S-MAX 2.0 TDCi Panther 110kW Titanium',
 'transmission': 'manual',
 'trim': '2.0 TDCi Panther 110kW Titanium',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981249%27 HTTP/1.1" 200 None
2026-03-24 18:31:49 [ayvens.es] INFO: Saving data for 1981249: {'created_time': 1774377109.998727, 'last_price_update_time': 1774377109.998737, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981249') HTTP/1.1" 204 0
2026-03-24 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1981248
2026-03-24 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1981248
2026-03-24 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1981248 to the API
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/675/e23c77b4d9d144cbaa12ad164dca1204/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris acero',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9aaa366d-6018-51ca-8a0c-131028ccd16f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 30981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa366d-6018-51ca-8a0c-131028ccd16f/9aaa366d-6018-51ca-8a0c-131028ccd16f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/675/e23c77b4d9d144cbaa12ad164dca1204/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 PureTech 100 S&S 6v Live Pack',
 'transmission': 'manual',
 'trim': 'PureTech 100 S&S 6v Live Pack',
 'vin': None,
 'year': 2023}
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981248%27 HTTP/1.1" 200 None
2026-03-24 18:31:50 [ayvens.es] INFO: Saving data for 1981248: {'created_time': 1774377110.284957, 'last_price_update_time': 1774377110.284968, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981248') HTTP/1.1" 204 0
2026-03-24 18:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/583/5d419d418f9c4b8c998dc9c4a9b21881/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:50 [ayvens.es] INFO: Found listing with ID: 1981259
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981259%27 HTTP/1.1" 200 None
2026-03-24 18:31:50 [ayvens.es] INFO: Scrape type for 1981259: 1
2026-03-24 18:31:50 [ayvens.es] INFO: Extracting data for car ID: 1981259
2026-03-24 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201a086b-2865-5df3-b7e0-2a5eb842cd1d with identifier: 1981259
2026-03-24 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201a086b-2865-5df3-b7e0-2a5eb842cd1d with scrape type 1
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 201a086b-2865-5df3-b7e0-2a5eb842cd1d
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F231%252F82e24f68e6ff40508f123f4df38af585%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/231/82e24f68e6ff40508f123f4df38af585/images/large/1.jpg not downloaded yet
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e3c90>
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19e0639a-9343-5bcd-9bbc-ffccc80f0af4/19e0639a-9343-5bcd-9bbc-ffccc80f0af4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F8029f8fcf37f4d6e9b040816a763be7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/8029f8fcf37f4d6e9b040816a763be7b/images/large/1.jpg saved to cache
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19e0639a-9343-5bcd-9bbc-ffccc80f0af4
2026-03-24 18:31:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19e0639a-9343-5bcd-9bbc-ffccc80f0af4, skipping ID generation
2026-03-24 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e0639a-9343-5bcd-9bbc-ffccc80f0af4 with scrape type 1
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19e0639a-9343-5bcd-9bbc-ffccc80f0af4 sending to next pipeline
2026-03-24 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 19e0639a-9343-5bcd-9bbc-ffccc80f0af4, identifier: 1981251
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1dead0>
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100b87c0-2dd8-5052-895b-f7e864cf4f15/100b87c0-2dd8-5052-895b-f7e864cf4f15_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F898%252Ffc39cb6b58eb4a75a4fb909519a2d059%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/898/fc39cb6b58eb4a75a4fb909519a2d059/images/large/1.jpg saved to cache
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 100b87c0-2dd8-5052-895b-f7e864cf4f15
2026-03-24 18:31:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 100b87c0-2dd8-5052-895b-f7e864cf4f15, skipping ID generation
2026-03-24 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100b87c0-2dd8-5052-895b-f7e864cf4f15 with scrape type 1
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 100b87c0-2dd8-5052-895b-f7e864cf4f15 sending to next pipeline
2026-03-24 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 100b87c0-2dd8-5052-895b-f7e864cf4f15, identifier: 1981250
2026-03-24 18:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/966/e8427a221ad44c06aff0e4efb30bdf9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:50 [ayvens.es] INFO: Found listing with ID: 1981260
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981260%27 HTTP/1.1" 200 None
2026-03-24 18:31:50 [ayvens.es] INFO: Scrape type for 1981260: 1
2026-03-24 18:31:50 [ayvens.es] INFO: Extracting data for car ID: 1981260
2026-03-24 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1981260
2026-03-24 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553cb826-5232-5663-a306-f409491bca25 with scrape type 1
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 553cb826-5232-5663-a306-f409491bca25
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Fe97dce141cd84c8c9e10ce5fda540112%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/e97dce141cd84c8c9e10ce5fda540112/images/large/1.jpg not downloaded yet
2026-03-24 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 19e0639a-9343-5bcd-9bbc-ffccc80f0af4 with identifier: 1981251
2026-03-24 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 19e0639a-9343-5bcd-9bbc-ffccc80f0af4 with identifier: 1981251
2026-03-24 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 19e0639a-9343-5bcd-9bbc-ffccc80f0af4 with identifier: 1981251 to the API
2026-03-24 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/664/8029f8fcf37f4d6e9b040816a763be7b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '19e0639a-9343-5bcd-9bbc-ffccc80f0af4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 191578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19e0639a-9343-5bcd-9bbc-ffccc80f0af4/19e0639a-9343-5bcd-9bbc-ffccc80f0af4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/8029f8fcf37f4d6e9b040816a763be7b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 85kW (116CV) SLE 4X2',
 'transmission': 'manual',
 'trim': '1.6 CRDI 85kW (116CV) SLE 4X2',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981251%27 HTTP/1.1" 200 None
2026-03-24 18:31:51 [ayvens.es] INFO: Saving data for 1981251: {'created_time': 1774377111.118365, 'last_price_update_time': 1774377111.118377, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981251') HTTP/1.1" 204 0
2026-03-24 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1981250
2026-03-24 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1981250
2026-03-24 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1981250 to the API
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/898/fc39cb6b58eb4a75a4fb909519a2d059/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Micron grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '100b87c0-2dd8-5052-895b-f7e864cf4f15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 188617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100b87c0-2dd8-5052-895b-f7e864cf4f15/100b87c0-2dd8-5052-895b-f7e864cf4f15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/898/fc39cb6b58eb4a75a4fb909519a2d059/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.7CRDi 115cv BlueDr. 25 Aniversario 4x2',
 'transmission': 'manual',
 'trim': '1.7CRDi 115cv BlueDr. 25 Aniversario 4x2',
 'vin': None,
 'year': 2017}
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981250%27 HTTP/1.1" 200 None
2026-03-24 18:31:51 [ayvens.es] INFO: Saving data for 1981250: {'created_time': 1774377111.508615, 'last_price_update_time': 1774377111.508624, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981250') HTTP/1.1" 204 0
2026-03-24 18:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/314/8d85d2bd450445fea5e480af4fa1130c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:51 [ayvens.es] INFO: Found listing with ID: 1981261
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981261%27 HTTP/1.1" 200 None
2026-03-24 18:31:51 [ayvens.es] INFO: Scrape type for 1981261: 1
2026-03-24 18:31:51 [ayvens.es] INFO: Extracting data for car ID: 1981261
2026-03-24 18:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1981261
2026-03-24 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33dda148-e54d-5a28-b1f9-9d8038482032 with scrape type 1
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33dda148-e54d-5a28-b1f9-9d8038482032
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F6f8b8093ca19465b83ed5fd166d87385%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/6f8b8093ca19465b83ed5fd166d87385/images/large/1.jpg not downloaded yet
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f9310>
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ef18afa-808d-50b4-958f-6d5617c1c869/6ef18afa-808d-50b4-958f-6d5617c1c869_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F583%252F5d419d418f9c4b8c998dc9c4a9b21881%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/583/5d419d418f9c4b8c998dc9c4a9b21881/images/large/1.jpg saved to cache
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ef18afa-808d-50b4-958f-6d5617c1c869
2026-03-24 18:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ef18afa-808d-50b4-958f-6d5617c1c869, skipping ID generation
2026-03-24 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef18afa-808d-50b4-958f-6d5617c1c869 with scrape type 1
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ef18afa-808d-50b4-958f-6d5617c1c869 sending to next pipeline
2026-03-24 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6ef18afa-808d-50b4-958f-6d5617c1c869, identifier: 1981252
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6c5010>
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991cd93-117d-52a3-8e8d-1211eb28962f/0991cd93-117d-52a3-8e8d-1211eb28962f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252Fe8427a221ad44c06aff0e4efb30bdf9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/e8427a221ad44c06aff0e4efb30bdf9b/images/large/1.jpg saved to cache
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0991cd93-117d-52a3-8e8d-1211eb28962f
2026-03-24 18:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0991cd93-117d-52a3-8e8d-1211eb28962f, skipping ID generation
2026-03-24 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0991cd93-117d-52a3-8e8d-1211eb28962f with scrape type 1
2026-03-24 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0991cd93-117d-52a3-8e8d-1211eb28962f sending to next pipeline
2026-03-24 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0991cd93-117d-52a3-8e8d-1211eb28962f, identifier: 1981253
2026-03-24 18:31:51 [ayvens.es] INFO: Found listing with ID: 1981262
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981262%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [ayvens.es] INFO: Scrape type for 1981262: 1
2026-03-24 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1981262
2026-03-24 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1981262
2026-03-24 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06646d94-ca2e-55f7-baf6-70a534a262cd with scrape type 1
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 06646d94-ca2e-55f7-baf6-70a534a262cd
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F576%252F5fc12eff12024034b8f73b2b9dcc3b35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/576/5fc12eff12024034b8f73b2b9dcc3b35/images/large/1.jpg not downloaded yet
2026-03-24 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6ef18afa-808d-50b4-958f-6d5617c1c869 with identifier: 1981252
2026-03-24 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6ef18afa-808d-50b4-958f-6d5617c1c869 with identifier: 1981252
2026-03-24 18:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6ef18afa-808d-50b4-958f-6d5617c1c869 with identifier: 1981252 to the API
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/583/5d419d418f9c4b8c998dc9c4a9b21881/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris oscuro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6ef18afa-808d-50b4-958f-6d5617c1c869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 70359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef18afa-808d-50b4-958f-6d5617c1c869/6ef18afa-808d-50b4-958f-6d5617c1c869_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/583/5d419d418f9c4b8c998dc9c4a9b21881/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 E-TENSE 225 TROCADERO',
 'transmission': 'manual',
 'trim': 'E-TENSE 225 TROCADERO',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981252%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [ayvens.es] INFO: Saving data for 1981252: {'created_time': 1774377112.404094, 'last_price_update_time': 1774377112.404116, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981252') HTTP/1.1" 204 0
2026-03-24 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1981253
2026-03-24 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1981253
2026-03-24 18:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1981253 to the API
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/966/e8427a221ad44c06aff0e4efb30bdf9b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0991cd93-117d-52a3-8e8d-1211eb28962f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 99101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991cd93-117d-52a3-8e8d-1211eb28962f/0991cd93-117d-52a3-8e8d-1211eb28962f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/966/e8427a221ad44c06aff0e4efb30bdf9b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Titanium HEV AT SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Titanium HEV AT SB',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981253%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [ayvens.es] INFO: Saving data for 1981253: {'created_time': 1774377112.711327, 'last_price_update_time': 1774377112.711338, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981253') HTTP/1.1" 204 0
2026-03-24 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/181/e51bd0ab7f3a4d25a008fa8714344e4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/399/b90ba04baf97479e9b2a3d061c497e6c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/342/0c7844c9fa1c49afae902d3341d979cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:52 [ayvens.es] INFO: Found listing with ID: 1981263
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981263%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [ayvens.es] INFO: Scrape type for 1981263: 1
2026-03-24 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1981263
2026-03-24 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11c956f7-3801-55e8-a8d7-ea05a9b0d5af with identifier: 1981263
2026-03-24 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11c956f7-3801-55e8-a8d7-ea05a9b0d5af with scrape type 1
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 11c956f7-3801-55e8-a8d7-ea05a9b0d5af
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F421%252Fb4dc9559966643babf4f49c79ec915a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/421/b4dc9559966643babf4f49c79ec915a9/images/large/1.jpg not downloaded yet
2026-03-24 18:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7cc1d0>
2026-03-24 18:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e6a504-dd90-5409-9225-60fdd1e09db0/c9e6a504-dd90-5409-9225-60fdd1e09db0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F314%252F8d85d2bd450445fea5e480af4fa1130c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/314/8d85d2bd450445fea5e480af4fa1130c/images/large/1.jpg saved to cache
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9e6a504-dd90-5409-9225-60fdd1e09db0
2026-03-24 18:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9e6a504-dd90-5409-9225-60fdd1e09db0, skipping ID generation
2026-03-24 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e6a504-dd90-5409-9225-60fdd1e09db0 with scrape type 1
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9e6a504-dd90-5409-9225-60fdd1e09db0 sending to next pipeline
2026-03-24 18:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9e6a504-dd90-5409-9225-60fdd1e09db0, identifier: 1981255
2026-03-24 18:31:52 [ayvens.es] INFO: Found listing with ID: 1981264
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981264%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [ayvens.es] INFO: Scrape type for 1981264: 1
2026-03-24 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1981264
2026-03-24 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fb135dd-14f7-5628-be81-022d925d8dc6 with identifier: 1981264
2026-03-24 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb135dd-14f7-5628-be81-022d925d8dc6 with scrape type 1
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1fb135dd-14f7-5628-be81-022d925d8dc6
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F853%252Fc6257ecbf72a4ba7896af42c53d29734%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/853/c6257ecbf72a4ba7896af42c53d29734/images/large/1.jpg not downloaded yet
2026-03-24 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1981255
2026-03-24 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1981255
2026-03-24 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1981255 to the API
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/314/8d85d2bd450445fea5e480af4fa1130c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Eiger grey metallic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9e6a504-dd90-5409-9225-60fdd1e09db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 53668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e6a504-dd90-5409-9225-60fdd1e09db0/c9e6a504-dd90-5409-9225-60fdd1e09db0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/314/8d85d2bd450445fea5e480af4fa1130c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981255%27 HTTP/1.1" 200 None
2026-03-24 18:31:53 [ayvens.es] INFO: Saving data for 1981255: {'created_time': 1774377113.240269, 'last_price_update_time': 1774377113.24028, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981255') HTTP/1.1" 204 0
2026-03-24 18:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/491/4e7f331933ee4421a6b58fadf4db3c21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:53 [ayvens.es] INFO: Found listing with ID: 1981265
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981265%27 HTTP/1.1" 200 None
2026-03-24 18:31:53 [ayvens.es] INFO: Scrape type for 1981265: 1
2026-03-24 18:31:53 [ayvens.es] INFO: Extracting data for car ID: 1981265
2026-03-24 18:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1981265
2026-03-24 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with scrape type 1
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F056e3538ed1143b9896c68d7a4637fa2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/056e3538ed1143b9896c68d7a4637fa2/images/large/1.jpg not downloaded yet
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f09aba50>
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fabcf9a1-7d50-5310-8b85-2c600fd6a2c7/fabcf9a1-7d50-5310-8b85-2c600fd6a2c7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F181%252Fe51bd0ab7f3a4d25a008fa8714344e4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/181/e51bd0ab7f3a4d25a008fa8714344e4d/images/large/1.jpg saved to cache
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fabcf9a1-7d50-5310-8b85-2c600fd6a2c7
2026-03-24 18:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fabcf9a1-7d50-5310-8b85-2c600fd6a2c7, skipping ID generation
2026-03-24 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fabcf9a1-7d50-5310-8b85-2c600fd6a2c7 with scrape type 1
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fabcf9a1-7d50-5310-8b85-2c600fd6a2c7 sending to next pipeline
2026-03-24 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fabcf9a1-7d50-5310-8b85-2c600fd6a2c7, identifier: 1981257
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eec94f10>
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfa67beb-3875-567a-ac77-b54abb0e00da/dfa67beb-3875-567a-ac77-b54abb0e00da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F399%252Fb90ba04baf97479e9b2a3d061c497e6c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/399/b90ba04baf97479e9b2a3d061c497e6c/images/large/1.jpg saved to cache
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfa67beb-3875-567a-ac77-b54abb0e00da
2026-03-24 18:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfa67beb-3875-567a-ac77-b54abb0e00da, skipping ID generation
2026-03-24 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa67beb-3875-567a-ac77-b54abb0e00da with scrape type 1
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfa67beb-3875-567a-ac77-b54abb0e00da sending to next pipeline
2026-03-24 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dfa67beb-3875-567a-ac77-b54abb0e00da, identifier: 1981256
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee987210>
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e993d71-0fea-5c85-bbc8-4823c7c2f9e8/7e993d71-0fea-5c85-bbc8-4823c7c2f9e8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F0c7844c9fa1c49afae902d3341d979cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/0c7844c9fa1c49afae902d3341d979cb/images/large/1.jpg saved to cache
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8
2026-03-24 18:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8, skipping ID generation
2026-03-24 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with scrape type 1
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 sending to next pipeline
2026-03-24 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8, identifier: 1981254
2026-03-24 18:31:53 [ayvens.es] INFO: Found listing with ID: 1981266
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981266%27 HTTP/1.1" 200 None
2026-03-24 18:31:53 [ayvens.es] INFO: Scrape type for 1981266: 1
2026-03-24 18:31:53 [ayvens.es] INFO: Extracting data for car ID: 1981266
2026-03-24 18:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1981266
2026-03-24 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99aed2e1-9cff-5d29-98c6-306339f8830c with scrape type 1
2026-03-24 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99aed2e1-9cff-5d29-98c6-306339f8830c
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252F309e22235c7b459da56367775b536aef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/309e22235c7b459da56367775b536aef/images/large/1.jpg not downloaded yet
2026-03-24 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fabcf9a1-7d50-5310-8b85-2c600fd6a2c7 with identifier: 1981257
2026-03-24 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fabcf9a1-7d50-5310-8b85-2c600fd6a2c7 with identifier: 1981257
2026-03-24 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fabcf9a1-7d50-5310-8b85-2c600fd6a2c7 with identifier: 1981257 to the API
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/181/e51bd0ab7f3a4d25a008fa8714344e4d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris terra',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fabcf9a1-7d50-5310-8b85-2c600fd6a2c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 142735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fabcf9a1-7d50-5310-8b85-2c600fd6a2c7/fabcf9a1-7d50-5310-8b85-2c600fd6a2c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/181/e51bd0ab7f3a4d25a008fa8714344e4d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 Advanced 30 TDI 100kW (136CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 30 TDI 100kW (136CV) S tronic',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981257%27 HTTP/1.1" 200 None
2026-03-24 18:31:54 [ayvens.es] INFO: Saving data for 1981257: {'created_time': 1774377114.445013, 'last_price_update_time': 1774377114.445023, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981257') HTTP/1.1" 204 0
2026-03-24 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dfa67beb-3875-567a-ac77-b54abb0e00da with identifier: 1981256
2026-03-24 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dfa67beb-3875-567a-ac77-b54abb0e00da with identifier: 1981256
2026-03-24 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dfa67beb-3875-567a-ac77-b54abb0e00da with identifier: 1981256 to the API
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/399/b90ba04baf97479e9b2a3d061c497e6c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dfa67beb-3875-567a-ac77-b54abb0e00da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 103064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfa67beb-3875-567a-ac77-b54abb0e00da/dfa67beb-3875-567a-ac77-b54abb0e00da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/399/b90ba04baf97479e9b2a3d061c497e6c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981256%27 HTTP/1.1" 200 None
2026-03-24 18:31:54 [ayvens.es] INFO: Saving data for 1981256: {'created_time': 1774377114.768978, 'last_price_update_time': 1774377114.768989, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981256') HTTP/1.1" 204 0
2026-03-24 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1981254
2026-03-24 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1981254
2026-03-24 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1981254 to the API
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/342/0c7844c9fa1c49afae902d3341d979cb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7e993d71-0fea-5c85-bbc8-4823c7c2f9e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 31989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e993d71-0fea-5c85-bbc8-4823c7c2f9e8/7e993d71-0fea-5c85-bbc8-4823c7c2f9e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/342/0c7844c9fa1c49afae902d3341d979cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'transmission': 'manual',
 'trim': 'IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'vin': None,
 'year': 2023}
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981254%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [ayvens.es] INFO: Saving data for 1981254: {'created_time': 1774377115.040522, 'last_price_update_time': 1774377115.040534, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981254') HTTP/1.1" 204 0
2026-03-24 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/e97dce141cd84c8c9e10ce5fda540112/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/426/6f8b8093ca19465b83ed5fd166d87385/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:55 [ayvens.es] INFO: Found listing with ID: 1981267
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981267%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [ayvens.es] INFO: Scrape type for 1981267: 1
2026-03-24 18:31:55 [ayvens.es] INFO: Extracting data for car ID: 1981267
2026-03-24 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98bb7aac-ec25-56de-8202-3c04e2b6cb49 with identifier: 1981267
2026-03-24 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98bb7aac-ec25-56de-8202-3c04e2b6cb49 with scrape type 1
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 98bb7aac-ec25-56de-8202-3c04e2b6cb49
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F220%252Fa195cb1783a54c899704375d656b7fbf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/220/a195cb1783a54c899704375d656b7fbf/images/large/1.jpg not downloaded yet
2026-03-24 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/231/82e24f68e6ff40508f123f4df38af585/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee84c210>
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0988a8-6681-5ab5-a077-e4f7ba3b6555/ab0988a8-6681-5ab5-a077-e4f7ba3b6555_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252F4e7f331933ee4421a6b58fadf4db3c21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/4e7f331933ee4421a6b58fadf4db3c21/images/large/1.jpg saved to cache
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555
2026-03-24 18:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab0988a8-6681-5ab5-a077-e4f7ba3b6555, skipping ID generation
2026-03-24 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with scrape type 1
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555 sending to next pipeline
2026-03-24 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab0988a8-6681-5ab5-a077-e4f7ba3b6555, identifier: 1981258
2026-03-24 18:31:55 [ayvens.es] INFO: Found listing with ID: 1981268
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981268%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [ayvens.es] INFO: Scrape type for 1981268: 1
2026-03-24 18:31:55 [ayvens.es] INFO: Extracting data for car ID: 1981268
2026-03-24 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1981268
2026-03-24 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a14685-3e89-5a53-be67-a8176f3787f6 with scrape type 1
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8a14685-3e89-5a53-be67-a8176f3787f6
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252Fef351174931e40afa0ad81b943dfb2b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/ef351174931e40afa0ad81b943dfb2b7/images/large/1.jpg not downloaded yet
2026-03-24 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1981258
2026-03-24 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1981258
2026-03-24 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1981258 to the API
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/491/4e7f331933ee4421a6b58fadf4db3c21/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab0988a8-6681-5ab5-a077-e4f7ba3b6555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 179393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0988a8-6681-5ab5-a077-e4f7ba3b6555/ab0988a8-6681-5ab5-a077-e4f7ba3b6555_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/491/4e7f331933ee4421a6b58fadf4db3c21/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Titanium',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Titanium',
 'vin': None,
 'year': 2020}
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981258%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [ayvens.es] INFO: Saving data for 1981258: {'created_time': 1774377115.652341, 'last_price_update_time': 1774377115.65235, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981258') HTTP/1.1" 204 0
2026-03-24 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/576/5fc12eff12024034b8f73b2b9dcc3b35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:55 [ayvens.es] INFO: Found listing with ID: 1981269
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981269%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [ayvens.es] INFO: Scrape type for 1981269: 1
2026-03-24 18:31:55 [ayvens.es] INFO: Extracting data for car ID: 1981269
2026-03-24 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c41558-0039-5281-b29f-6091dd9bfe2d with identifier: 1981269
2026-03-24 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c41558-0039-5281-b29f-6091dd9bfe2d with scrape type 1
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48c41558-0039-5281-b29f-6091dd9bfe2d
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Ff45f0f45b42a4ffeab7ea9ec7d2070d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/f45f0f45b42a4ffeab7ea9ec7d2070d0/images/large/1.jpg not downloaded yet
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee84e450>
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553cb826-5232-5663-a306-f409491bca25/553cb826-5232-5663-a306-f409491bca25_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Fe97dce141cd84c8c9e10ce5fda540112%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/e97dce141cd84c8c9e10ce5fda540112/images/large/1.jpg saved to cache
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 553cb826-5232-5663-a306-f409491bca25
2026-03-24 18:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 553cb826-5232-5663-a306-f409491bca25, skipping ID generation
2026-03-24 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553cb826-5232-5663-a306-f409491bca25 with scrape type 1
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 553cb826-5232-5663-a306-f409491bca25 sending to next pipeline
2026-03-24 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 553cb826-5232-5663-a306-f409491bca25, identifier: 1981260
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee889ad0>
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dda148-e54d-5a28-b1f9-9d8038482032/33dda148-e54d-5a28-b1f9-9d8038482032_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F6f8b8093ca19465b83ed5fd166d87385%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/6f8b8093ca19465b83ed5fd166d87385/images/large/1.jpg saved to cache
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33dda148-e54d-5a28-b1f9-9d8038482032
2026-03-24 18:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33dda148-e54d-5a28-b1f9-9d8038482032, skipping ID generation
2026-03-24 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33dda148-e54d-5a28-b1f9-9d8038482032 with scrape type 1
2026-03-24 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33dda148-e54d-5a28-b1f9-9d8038482032 sending to next pipeline
2026-03-24 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33dda148-e54d-5a28-b1f9-9d8038482032, identifier: 1981261
2026-03-24 18:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee945c90>
2026-03-24 18:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_201a086b-2865-5df3-b7e0-2a5eb842cd1d/201a086b-2865-5df3-b7e0-2a5eb842cd1d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F231%252F82e24f68e6ff40508f123f4df38af585%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/231/82e24f68e6ff40508f123f4df38af585/images/large/1.jpg saved to cache
2026-03-24 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 201a086b-2865-5df3-b7e0-2a5eb842cd1d
2026-03-24 18:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 201a086b-2865-5df3-b7e0-2a5eb842cd1d, skipping ID generation
2026-03-24 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201a086b-2865-5df3-b7e0-2a5eb842cd1d with scrape type 1
2026-03-24 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 201a086b-2865-5df3-b7e0-2a5eb842cd1d sending to next pipeline
2026-03-24 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 201a086b-2865-5df3-b7e0-2a5eb842cd1d, identifier: 1981259
2026-03-24 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1981260
2026-03-24 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1981260
2026-03-24 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1981260 to the API
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/e97dce141cd84c8c9e10ce5fda540112/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '553cb826-5232-5663-a306-f409491bca25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 101227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553cb826-5232-5663-a306-f409491bca25/553cb826-5232-5663-a306-f409491bca25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/e97dce141cd84c8c9e10ce5fda540112/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981260%27 HTTP/1.1" 200 None
2026-03-24 18:31:56 [ayvens.es] INFO: Saving data for 1981260: {'created_time': 1774377116.470954, 'last_price_update_time': 1774377116.470964, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981260') HTTP/1.1" 204 0
2026-03-24 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1981261
2026-03-24 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1981261
2026-03-24 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1981261 to the API
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/426/6f8b8093ca19465b83ed5fd166d87385/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '33dda148-e54d-5a28-b1f9-9d8038482032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 102359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33dda148-e54d-5a28-b1f9-9d8038482032/33dda148-e54d-5a28-b1f9-9d8038482032_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/426/6f8b8093ca19465b83ed5fd166d87385/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981261%27 HTTP/1.1" 200 None
2026-03-24 18:31:56 [ayvens.es] INFO: Saving data for 1981261: {'created_time': 1774377116.757236, 'last_price_update_time': 1774377116.757246, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981261') HTTP/1.1" 204 0
2026-03-24 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 201a086b-2865-5df3-b7e0-2a5eb842cd1d with identifier: 1981259
2026-03-24 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 201a086b-2865-5df3-b7e0-2a5eb842cd1d with identifier: 1981259
2026-03-24 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 201a086b-2865-5df3-b7e0-2a5eb842cd1d with identifier: 1981259 to the API
2026-03-24 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/231/82e24f68e6ff40508f123f4df38af585/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Azul navarra',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '201a086b-2865-5df3-b7e0-2a5eb842cd1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 53747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_201a086b-2865-5df3-b7e0-2a5eb842cd1d/201a086b-2865-5df3-b7e0-2a5eb842cd1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/231/82e24f68e6ff40508f123f4df38af585/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Advanced 50 TFSI e quattro-ultra',
 'transmission': 'manual',
 'trim': 'Advanced 50 TFSI e quattro-ultra',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981259%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [ayvens.es] INFO: Saving data for 1981259: {'created_time': 1774377117.1837, 'last_price_update_time': 1774377117.18371, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981259') HTTP/1.1" 204 0
2026-03-24 18:31:57 [ayvens.es] INFO: Found listing with ID: 1981270
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981270%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [ayvens.es] INFO: Scrape type for 1981270: 1
2026-03-24 18:31:57 [ayvens.es] INFO: Extracting data for car ID: 1981270
2026-03-24 18:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27ee452-627a-59a7-b113-d4227404f1d5 with identifier: 1981270
2026-03-24 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27ee452-627a-59a7-b113-d4227404f1d5 with scrape type 1
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a27ee452-627a-59a7-b113-d4227404f1d5
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F605%252Fdcd34eeb525b42f0a3cbf552fd5d6a0b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/605/dcd34eeb525b42f0a3cbf552fd5d6a0b/images/large/1.jpg not downloaded yet
2026-03-24 18:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/421/b4dc9559966643babf4f49c79ec915a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9ec950>
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06646d94-ca2e-55f7-baf6-70a534a262cd/06646d94-ca2e-55f7-baf6-70a534a262cd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F576%252F5fc12eff12024034b8f73b2b9dcc3b35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/576/5fc12eff12024034b8f73b2b9dcc3b35/images/large/1.jpg saved to cache
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06646d94-ca2e-55f7-baf6-70a534a262cd
2026-03-24 18:31:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06646d94-ca2e-55f7-baf6-70a534a262cd, skipping ID generation
2026-03-24 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06646d94-ca2e-55f7-baf6-70a534a262cd with scrape type 1
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06646d94-ca2e-55f7-baf6-70a534a262cd sending to next pipeline
2026-03-24 18:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 06646d94-ca2e-55f7-baf6-70a534a262cd, identifier: 1981262
2026-03-24 18:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/853/c6257ecbf72a4ba7896af42c53d29734/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/620/056e3538ed1143b9896c68d7a4637fa2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:57 [ayvens.es] INFO: Found listing with ID: 1981271
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981271%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [ayvens.es] INFO: Scrape type for 1981271: 1
2026-03-24 18:31:57 [ayvens.es] INFO: Extracting data for car ID: 1981271
2026-03-24 18:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0249eb94-7c3b-517d-bcfe-3713e9a35f39 with identifier: 1981271
2026-03-24 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0249eb94-7c3b-517d-bcfe-3713e9a35f39 with scrape type 1
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0249eb94-7c3b-517d-bcfe-3713e9a35f39
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F610b7c1b62b34e2a9e2629735f4dc36f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/610b7c1b62b34e2a9e2629735f4dc36f/images/large/1.jpg not downloaded yet
2026-03-24 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1981262
2026-03-24 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1981262
2026-03-24 18:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1981262 to the API
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/576/5fc12eff12024034b8f73b2b9dcc3b35/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Rojo lucid',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '06646d94-ca2e-55f7-baf6-70a534a262cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 164919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06646d94-ca2e-55f7-baf6-70a534a262cd/06646d94-ca2e-55f7-baf6-70a534a262cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/576/5fc12eff12024034b8f73b2b9dcc3b35/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec PHEV 165kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec PHEV 165kW Auto',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981262%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [ayvens.es] INFO: Saving data for 1981262: {'created_time': 1774377117.739357, 'last_price_update_time': 1774377117.739369, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981262') HTTP/1.1" 204 0
2026-03-24 18:31:57 [ayvens.es] INFO: Found listing with ID: 1981272
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981272%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [ayvens.es] INFO: Scrape type for 1981272: 1
2026-03-24 18:31:57 [ayvens.es] INFO: Extracting data for car ID: 1981272
2026-03-24 18:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1981272
2026-03-24 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with scrape type 1
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252F7e752f412b70444cb691be2b02cd000a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/7e752f412b70444cb691be2b02cd000a/images/large/1.jpg not downloaded yet
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6df310>
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c956f7-3801-55e8-a8d7-ea05a9b0d5af/11c956f7-3801-55e8-a8d7-ea05a9b0d5af_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F421%252Fb4dc9559966643babf4f49c79ec915a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/421/b4dc9559966643babf4f49c79ec915a9/images/large/1.jpg saved to cache
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11c956f7-3801-55e8-a8d7-ea05a9b0d5af
2026-03-24 18:31:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11c956f7-3801-55e8-a8d7-ea05a9b0d5af, skipping ID generation
2026-03-24 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11c956f7-3801-55e8-a8d7-ea05a9b0d5af with scrape type 1
2026-03-24 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11c956f7-3801-55e8-a8d7-ea05a9b0d5af sending to next pipeline
2026-03-24 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 11c956f7-3801-55e8-a8d7-ea05a9b0d5af, identifier: 1981263
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee984210>
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb135dd-14f7-5628-be81-022d925d8dc6/1fb135dd-14f7-5628-be81-022d925d8dc6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F853%252Fc6257ecbf72a4ba7896af42c53d29734%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/853/c6257ecbf72a4ba7896af42c53d29734/images/large/1.jpg saved to cache
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fb135dd-14f7-5628-be81-022d925d8dc6
2026-03-24 18:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fb135dd-14f7-5628-be81-022d925d8dc6, skipping ID generation
2026-03-24 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb135dd-14f7-5628-be81-022d925d8dc6 with scrape type 1
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fb135dd-14f7-5628-be81-022d925d8dc6 sending to next pipeline
2026-03-24 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1fb135dd-14f7-5628-be81-022d925d8dc6, identifier: 1981264
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7cd1d0>
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd9a2ccb-c26b-53d1-8985-a82109cfa4d2/fd9a2ccb-c26b-53d1-8985-a82109cfa4d2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F056e3538ed1143b9896c68d7a4637fa2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/056e3538ed1143b9896c68d7a4637fa2/images/large/1.jpg saved to cache
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2
2026-03-24 18:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2, skipping ID generation
2026-03-24 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with scrape type 1
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 sending to next pipeline
2026-03-24 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2, identifier: 1981265
2026-03-24 18:31:58 [ayvens.es] INFO: Found listing with ID: 1981273
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981273%27 HTTP/1.1" 200 None
2026-03-24 18:31:58 [ayvens.es] INFO: Scrape type for 1981273: 1
2026-03-24 18:31:58 [ayvens.es] INFO: Extracting data for car ID: 1981273
2026-03-24 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1981273
2026-03-24 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2065a08-b765-5a2c-a1c1-9441b54dd62d with scrape type 1
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2065a08-b765-5a2c-a1c1-9441b54dd62d
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F05e90bce65064cb9b9981bb04fe80c78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/05e90bce65064cb9b9981bb04fe80c78/images/large/1.jpg not downloaded yet
2026-03-24 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 11c956f7-3801-55e8-a8d7-ea05a9b0d5af with identifier: 1981263
2026-03-24 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 11c956f7-3801-55e8-a8d7-ea05a9b0d5af with identifier: 1981263
2026-03-24 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 11c956f7-3801-55e8-a8d7-ea05a9b0d5af with identifier: 1981263 to the API
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/421/b4dc9559966643babf4f49c79ec915a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'color': 'Saphirschwarz metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '11c956f7-3801-55e8-a8d7-ea05a9b0d5af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2 ACTIVE TOURER',
 'odometer': 86158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c956f7-3801-55e8-a8d7-ea05a9b0d5af/11c956f7-3801-55e8-a8d7-ea05a9b0d5af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/421/b4dc9559966643babf4f49c79ec915a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 ACTIVE TOURER 225xe iPerformance',
 'transmission': 'manual',
 'trim': '225xe iPerformance',
 'vin': None,
 'year': 2021}
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981263%27 HTTP/1.1" 200 None
2026-03-24 18:31:58 [ayvens.es] INFO: Saving data for 1981263: {'created_time': 1774377118.771357, 'last_price_update_time': 1774377118.771367, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981263') HTTP/1.1" 204 0
2026-03-24 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1fb135dd-14f7-5628-be81-022d925d8dc6 with identifier: 1981264
2026-03-24 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1fb135dd-14f7-5628-be81-022d925d8dc6 with identifier: 1981264
2026-03-24 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1fb135dd-14f7-5628-be81-022d925d8dc6 with identifier: 1981264 to the API
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/853/c6257ecbf72a4ba7896af42c53d29734/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Blau metallic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1fb135dd-14f7-5628-be81-022d925d8dc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 12378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb135dd-14f7-5628-be81-022d925d8dc6/1fb135dd-14f7-5628-be81-022d925d8dc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/853/c6257ecbf72a4ba7896af42c53d29734/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive25e Auto',
 'transmission': 'manual',
 'trim': 'xDrive25e Auto',
 'vin': None,
 'year': 2023}
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981264%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [ayvens.es] INFO: Saving data for 1981264: {'created_time': 1774377119.082527, 'last_price_update_time': 1774377119.082539, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981264') HTTP/1.1" 204 0
2026-03-24 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1981265
2026-03-24 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1981265
2026-03-24 18:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1981265 to the API
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/620/056e3538ed1143b9896c68d7a4637fa2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Cristal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fd9a2ccb-c26b-53d1-8985-a82109cfa4d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 93829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9a2ccb-c26b-53d1-8985-a82109cfa4d2/fd9a2ccb-c26b-53d1-8985-a82109cfa4d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/620/056e3538ed1143b9896c68d7a4637fa2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 Auto Bastille +',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 Auto Bastille +',
 'vin': None,
 'year': 2022}
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981265%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [ayvens.es] INFO: Saving data for 1981265: {'created_time': 1774377119.375167, 'last_price_update_time': 1774377119.375177, 'auction_closing_time': 1774440000.0}
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981265') HTTP/1.1" 204 0
2026-03-24 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/220/a195cb1783a54c899704375d656b7fbf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/309e22235c7b459da56367775b536aef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/899/ef351174931e40afa0ad81b943dfb2b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:59 [ayvens.es] INFO: Found listing with ID: 1981274
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981274%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [ayvens.es] INFO: Scrape type for 1981274: 1
2026-03-24 18:31:59 [ayvens.es] INFO: Extracting data for car ID: 1981274
2026-03-24 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1981274
2026-03-24 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701736a7-8a18-59cb-af86-0eab0d5edb3a with scrape type 1
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 701736a7-8a18-59cb-af86-0eab0d5edb3a
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F44df6f42ac13427f8381ce8d91c4a21b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/44df6f42ac13427f8381ce8d91c4a21b/images/large/1.jpg not downloaded yet
2026-03-24 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/840/f45f0f45b42a4ffeab7ea9ec7d2070d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:59 [ayvens.es] INFO: Found listing with ID: 1981275
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981275%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [ayvens.es] INFO: Scrape type for 1981275: 1
2026-03-24 18:31:59 [ayvens.es] INFO: Extracting data for car ID: 1981275
2026-03-24 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d007b6b-6082-554a-8020-9b0aa78d8841 with identifier: 1981275
2026-03-24 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d007b6b-6082-554a-8020-9b0aa78d8841 with scrape type 1
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d007b6b-6082-554a-8020-9b0aa78d8841
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252Fe84d708cd78e42d69de9cca3324c3624%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/e84d708cd78e42d69de9cca3324c3624/images/large/1.jpg not downloaded yet
2026-03-24 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/605/dcd34eeb525b42f0a3cbf552fd5d6a0b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:59 [ayvens.es] INFO: Found listing with ID: 1981276
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981276%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [ayvens.es] INFO: Scrape type for 1981276: 1
2026-03-24 18:31:59 [ayvens.es] INFO: Extracting data for car ID: 1981276
2026-03-24 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 834e79af-cb13-5d50-beea-dd17860c7862 with identifier: 1981276
2026-03-24 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834e79af-cb13-5d50-beea-dd17860c7862 with scrape type 1
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 834e79af-cb13-5d50-beea-dd17860c7862
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252F965b123cc2ec4ab0b27cb59f813fadda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/965b123cc2ec4ab0b27cb59f813fadda/images/large/1.jpg not downloaded yet
2026-03-24 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/049/610b7c1b62b34e2a9e2629735f4dc36f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:31:59 [ayvens.es] INFO: Found listing with ID: 1981277
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981277%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [ayvens.es] INFO: Scrape type for 1981277: 1
2026-03-24 18:31:59 [ayvens.es] INFO: Extracting data for car ID: 1981277
2026-03-24 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1981277
2026-03-24 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with scrape type 1
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F764%252Ffe8b29bc87094a61850028ed0db5f6f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/764/fe8b29bc87094a61850028ed0db5f6f3/images/large/1.jpg not downloaded yet
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee935f90>
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98bb7aac-ec25-56de-8202-3c04e2b6cb49/98bb7aac-ec25-56de-8202-3c04e2b6cb49_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F220%252Fa195cb1783a54c899704375d656b7fbf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/220/a195cb1783a54c899704375d656b7fbf/images/large/1.jpg saved to cache
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98bb7aac-ec25-56de-8202-3c04e2b6cb49
2026-03-24 18:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98bb7aac-ec25-56de-8202-3c04e2b6cb49, skipping ID generation
2026-03-24 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98bb7aac-ec25-56de-8202-3c04e2b6cb49 with scrape type 1
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98bb7aac-ec25-56de-8202-3c04e2b6cb49 sending to next pipeline
2026-03-24 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 98bb7aac-ec25-56de-8202-3c04e2b6cb49, identifier: 1981267
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee96ad50>
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99aed2e1-9cff-5d29-98c6-306339f8830c/99aed2e1-9cff-5d29-98c6-306339f8830c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252F309e22235c7b459da56367775b536aef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/309e22235c7b459da56367775b536aef/images/large/1.jpg saved to cache
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99aed2e1-9cff-5d29-98c6-306339f8830c
2026-03-24 18:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99aed2e1-9cff-5d29-98c6-306339f8830c, skipping ID generation
2026-03-24 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99aed2e1-9cff-5d29-98c6-306339f8830c with scrape type 1
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99aed2e1-9cff-5d29-98c6-306339f8830c sending to next pipeline
2026-03-24 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99aed2e1-9cff-5d29-98c6-306339f8830c, identifier: 1981266
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0c1e50>
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a14685-3e89-5a53-be67-a8176f3787f6/c8a14685-3e89-5a53-be67-a8176f3787f6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252Fef351174931e40afa0ad81b943dfb2b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/ef351174931e40afa0ad81b943dfb2b7/images/large/1.jpg saved to cache
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8a14685-3e89-5a53-be67-a8176f3787f6
2026-03-24 18:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8a14685-3e89-5a53-be67-a8176f3787f6, skipping ID generation
2026-03-24 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a14685-3e89-5a53-be67-a8176f3787f6 with scrape type 1
2026-03-24 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8a14685-3e89-5a53-be67-a8176f3787f6 sending to next pipeline
2026-03-24 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8a14685-3e89-5a53-be67-a8176f3787f6, identifier: 1981268
2026-03-24 18:32:00 [ayvens.es] INFO: Found listing with ID: 1981278
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981278%27 HTTP/1.1" 200 None
2026-03-24 18:32:00 [ayvens.es] INFO: Scrape type for 1981278: 1
2026-03-24 18:32:00 [ayvens.es] INFO: Extracting data for car ID: 1981278
2026-03-24 18:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1981278
2026-03-24 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with scrape type 1
2026-03-24 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F2e0dd67c36e74e2887efe0264a570413%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/2e0dd67c36e74e2887efe0264a570413/images/large/1.jpg not downloaded yet
2026-03-24 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 98bb7aac-ec25-56de-8202-3c04e2b6cb49 with identifier: 1981267
2026-03-24 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 98bb7aac-ec25-56de-8202-3c04e2b6cb49 with identifier: 1981267
2026-03-24 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 98bb7aac-ec25-56de-8202-3c04e2b6cb49 with identifier: 1981267 to the API
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/220/a195cb1783a54c899704375d656b7fbf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '98bb7aac-ec25-56de-8202-3c04e2b6cb49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 64011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bb7aac-ec25-56de-8202-3c04e2b6cb49/98bb7aac-ec25-56de-8202-3c04e2b6cb49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/220/a195cb1783a54c899704375d656b7fbf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981267%27 HTTP/1.1" 200 None
2026-03-24 18:32:00 [ayvens.es] INFO: Saving data for 1981267: {'created_time': 1774377120.406463, 'last_price_update_time': 1774377120.406473, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981267') HTTP/1.1" 204 0
2026-03-24 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1981266
2026-03-24 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1981266
2026-03-24 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1981266 to the API
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/056/309e22235c7b459da56367775b536aef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '99aed2e1-9cff-5d29-98c6-306339f8830c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 151563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99aed2e1-9cff-5d29-98c6-306339f8830c/99aed2e1-9cff-5d29-98c6-306339f8830c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/309e22235c7b459da56367775b536aef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P BUSINESS LINE 1.6 BlueHDi 55KW (75CV)',
 'transmission': 'manual',
 'trim': '5P BUSINESS LINE 1.6 BlueHDi 55KW (75CV)',
 'vin': None,
 'year': 2017}
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981266%27 HTTP/1.1" 200 None
2026-03-24 18:32:00 [ayvens.es] INFO: Saving data for 1981266: {'created_time': 1774377120.690864, 'last_price_update_time': 1774377120.690874, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981266') HTTP/1.1" 204 0
2026-03-24 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1981268
2026-03-24 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1981268
2026-03-24 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1981268 to the API
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/899/ef351174931e40afa0ad81b943dfb2b7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c8a14685-3e89-5a53-be67-a8176f3787f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 99628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a14685-3e89-5a53-be67-a8176f3787f6/c8a14685-3e89-5a53-be67-a8176f3787f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/899/ef351174931e40afa0ad81b943dfb2b7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981268%27 HTTP/1.1" 200 None
2026-03-24 18:32:01 [ayvens.es] INFO: Saving data for 1981268: {'created_time': 1774377121.403503, 'last_price_update_time': 1774377121.403516, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981268') HTTP/1.1" 204 0
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1dc690>
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c41558-0039-5281-b29f-6091dd9bfe2d/48c41558-0039-5281-b29f-6091dd9bfe2d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Ff45f0f45b42a4ffeab7ea9ec7d2070d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/f45f0f45b42a4ffeab7ea9ec7d2070d0/images/large/1.jpg saved to cache
2026-03-24 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48c41558-0039-5281-b29f-6091dd9bfe2d
2026-03-24 18:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48c41558-0039-5281-b29f-6091dd9bfe2d, skipping ID generation
2026-03-24 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c41558-0039-5281-b29f-6091dd9bfe2d with scrape type 1
2026-03-24 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48c41558-0039-5281-b29f-6091dd9bfe2d sending to next pipeline
2026-03-24 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 48c41558-0039-5281-b29f-6091dd9bfe2d, identifier: 1981269
2026-03-24 18:32:01 [ayvens.es] INFO: Found listing with ID: 1981279
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981279%27 HTTP/1.1" 200 None
2026-03-24 18:32:01 [ayvens.es] INFO: Scrape type for 1981279: 1
2026-03-24 18:32:01 [ayvens.es] INFO: Extracting data for car ID: 1981279
2026-03-24 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1981279
2026-03-24 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bf23cb-9e65-5a55-9197-e8a828180e6c with scrape type 1
2026-03-24 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01bf23cb-9e65-5a55-9197-e8a828180e6c
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F138%252Fb05b8579aaa44cd282c9a888a4f2dd83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/138/b05b8579aaa44cd282c9a888a4f2dd83/images/large/1.jpg not downloaded yet
2026-03-24 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 48c41558-0039-5281-b29f-6091dd9bfe2d with identifier: 1981269
2026-03-24 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 48c41558-0039-5281-b29f-6091dd9bfe2d with identifier: 1981269
2026-03-24 18:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 48c41558-0039-5281-b29f-6091dd9bfe2d with identifier: 1981269 to the API
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/840/f45f0f45b42a4ffeab7ea9ec7d2070d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Rojo rioja',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '48c41558-0039-5281-b29f-6091dd9bfe2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA',
 'odometer': 167269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c41558-0039-5281-b29f-6091dd9bfe2d/48c41558-0039-5281-b29f-6091dd9bfe2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/840/f45f0f45b42a4ffeab7ea9ec7d2070d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA GS Business Edition 1.5D DVH 90kW MT6',
 'transmission': 'manual',
 'trim': 'GS Business Edition 1.5D DVH 90kW MT6',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981269%27 HTTP/1.1" 200 None
2026-03-24 18:32:01 [ayvens.es] INFO: Saving data for 1981269: {'created_time': 1774377121.900613, 'last_price_update_time': 1774377121.900624, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981269') HTTP/1.1" 204 0
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6dec90>
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27ee452-627a-59a7-b113-d4227404f1d5/a27ee452-627a-59a7-b113-d4227404f1d5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F605%252Fdcd34eeb525b42f0a3cbf552fd5d6a0b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/605/dcd34eeb525b42f0a3cbf552fd5d6a0b/images/large/1.jpg saved to cache
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a27ee452-627a-59a7-b113-d4227404f1d5
2026-03-24 18:32:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a27ee452-627a-59a7-b113-d4227404f1d5, skipping ID generation
2026-03-24 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27ee452-627a-59a7-b113-d4227404f1d5 with scrape type 1
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a27ee452-627a-59a7-b113-d4227404f1d5 sending to next pipeline
2026-03-24 18:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a27ee452-627a-59a7-b113-d4227404f1d5, identifier: 1981270
2026-03-24 18:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee219cd0>
2026-03-24 18:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0249eb94-7c3b-517d-bcfe-3713e9a35f39/0249eb94-7c3b-517d-bcfe-3713e9a35f39_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F610b7c1b62b34e2a9e2629735f4dc36f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/610b7c1b62b34e2a9e2629735f4dc36f/images/large/1.jpg saved to cache
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0249eb94-7c3b-517d-bcfe-3713e9a35f39
2026-03-24 18:32:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0249eb94-7c3b-517d-bcfe-3713e9a35f39, skipping ID generation
2026-03-24 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0249eb94-7c3b-517d-bcfe-3713e9a35f39 with scrape type 1
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0249eb94-7c3b-517d-bcfe-3713e9a35f39 sending to next pipeline
2026-03-24 18:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0249eb94-7c3b-517d-bcfe-3713e9a35f39, identifier: 1981271
2026-03-24 18:32:02 [ayvens.es] INFO: Found listing with ID: 1981280
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981280%27 HTTP/1.1" 200 None
2026-03-24 18:32:02 [ayvens.es] INFO: Scrape type for 1981280: 1
2026-03-24 18:32:02 [ayvens.es] INFO: Extracting data for car ID: 1981280
2026-03-24 18:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1981280
2026-03-24 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with scrape type 1
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fdbbc7bccd60540aba194d65e3ca7b575%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/dbbc7bccd60540aba194d65e3ca7b575/images/large/1.jpg not downloaded yet
2026-03-24 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a27ee452-627a-59a7-b113-d4227404f1d5 with identifier: 1981270
2026-03-24 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a27ee452-627a-59a7-b113-d4227404f1d5 with identifier: 1981270
2026-03-24 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a27ee452-627a-59a7-b113-d4227404f1d5 with identifier: 1981270 to the API
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/605/dcd34eeb525b42f0a3cbf552fd5d6a0b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Gris nano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a27ee452-627a-59a7-b113-d4227404f1d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 111741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ee452-627a-59a7-b113-d4227404f1d5/a27ee452-627a-59a7-b113-d4227404f1d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/605/dcd34eeb525b42f0a3cbf552fd5d6a0b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 Advanced 30 TDI 85kW (116CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 30 TDI 85kW (116CV) S tronic',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981270%27 HTTP/1.1" 200 None
2026-03-24 18:32:02 [ayvens.es] INFO: Saving data for 1981270: {'created_time': 1774377122.643125, 'last_price_update_time': 1774377122.643135, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981270') HTTP/1.1" 204 0
2026-03-24 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0249eb94-7c3b-517d-bcfe-3713e9a35f39 with identifier: 1981271
2026-03-24 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0249eb94-7c3b-517d-bcfe-3713e9a35f39 with identifier: 1981271
2026-03-24 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0249eb94-7c3b-517d-bcfe-3713e9a35f39 with identifier: 1981271 to the API
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/049/610b7c1b62b34e2a9e2629735f4dc36f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Plata solar metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0249eb94-7c3b-517d-bcfe-3713e9a35f39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 52276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0249eb94-7c3b-517d-bcfe-3713e9a35f39/0249eb94-7c3b-517d-bcfe-3713e9a35f39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/049/610b7c1b62b34e2a9e2629735f4dc36f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 125cv ST-Line X MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125cv ST-Line X MHEV',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981271%27 HTTP/1.1" 200 None
2026-03-24 18:32:02 [ayvens.es] INFO: Saving data for 1981271: {'created_time': 1774377122.937869, 'last_price_update_time': 1774377122.937879, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981271') HTTP/1.1" 204 0
2026-03-24 18:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/803/7e752f412b70444cb691be2b02cd000a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/543/44df6f42ac13427f8381ce8d91c4a21b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/110/e84d708cd78e42d69de9cca3324c3624/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/090/965b123cc2ec4ab0b27cb59f813fadda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:02 [ayvens.es] INFO: Found listing with ID: 1981281
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981281%27 HTTP/1.1" 200 None
2026-03-24 18:32:02 [ayvens.es] INFO: Scrape type for 1981281: 1
2026-03-24 18:32:02 [ayvens.es] INFO: Extracting data for car ID: 1981281
2026-03-24 18:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0266cc-6634-5889-8355-e710f4b61f0c with identifier: 1981281
2026-03-24 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0266cc-6634-5889-8355-e710f4b61f0c with scrape type 1
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e0266cc-6634-5889-8355-e710f4b61f0c
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F250%252Feb639246b11d46e8b7599ed01b3343ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/250/eb639246b11d46e8b7599ed01b3343ea/images/large/1.jpg not downloaded yet
2026-03-24 18:32:03 [ayvens.es] INFO: Found listing with ID: 1981282
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981282%27 HTTP/1.1" 200 None
2026-03-24 18:32:03 [ayvens.es] INFO: Scrape type for 1981282: 1
2026-03-24 18:32:03 [ayvens.es] INFO: Extracting data for car ID: 1981282
2026-03-24 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1981282
2026-03-24 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab807c69-ed34-54f3-b7d2-7914be56a415 with scrape type 1
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab807c69-ed34-54f3-b7d2-7914be56a415
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fa7c0f5585c7d4ef9a3b0f05d6b4fb034%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/a7c0f5585c7d4ef9a3b0f05d6b4fb034/images/large/1.jpg not downloaded yet
2026-03-24 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/531/05e90bce65064cb9b9981bb04fe80c78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/764/fe8b29bc87094a61850028ed0db5f6f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:03 [ayvens.es] INFO: Found listing with ID: 1981283
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981283%27 HTTP/1.1" 200 None
2026-03-24 18:32:03 [ayvens.es] INFO: Scrape type for 1981283: 1
2026-03-24 18:32:03 [ayvens.es] INFO: Extracting data for car ID: 1981283
2026-03-24 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f436c9e-9717-5a70-a3ab-24b3b10ddf27 with identifier: 1981283
2026-03-24 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f436c9e-9717-5a70-a3ab-24b3b10ddf27 with scrape type 1
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f436c9e-9717-5a70-a3ab-24b3b10ddf27
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F767%252F8985140d65e743a8b0fdf37e1131eb3e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/767/8985140d65e743a8b0fdf37e1131eb3e/images/large/1.jpg not downloaded yet
2026-03-24 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/415/2e0dd67c36e74e2887efe0264a570413/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f8ed0>
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8d31e8b-d6e7-5ef5-9266-6698f58b02ea/f8d31e8b-d6e7-5ef5-9266-6698f58b02ea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252F7e752f412b70444cb691be2b02cd000a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/7e752f412b70444cb691be2b02cd000a/images/large/1.jpg saved to cache
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea
2026-03-24 18:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea, skipping ID generation
2026-03-24 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with scrape type 1
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea sending to next pipeline
2026-03-24 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea, identifier: 1981272
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecca150>
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701736a7-8a18-59cb-af86-0eab0d5edb3a/701736a7-8a18-59cb-af86-0eab0d5edb3a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F44df6f42ac13427f8381ce8d91c4a21b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/44df6f42ac13427f8381ce8d91c4a21b/images/large/1.jpg saved to cache
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 701736a7-8a18-59cb-af86-0eab0d5edb3a
2026-03-24 18:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 701736a7-8a18-59cb-af86-0eab0d5edb3a, skipping ID generation
2026-03-24 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701736a7-8a18-59cb-af86-0eab0d5edb3a with scrape type 1
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 701736a7-8a18-59cb-af86-0eab0d5edb3a sending to next pipeline
2026-03-24 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 701736a7-8a18-59cb-af86-0eab0d5edb3a, identifier: 1981274
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8c9d50>
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d007b6b-6082-554a-8020-9b0aa78d8841/7d007b6b-6082-554a-8020-9b0aa78d8841_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252Fe84d708cd78e42d69de9cca3324c3624%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/e84d708cd78e42d69de9cca3324c3624/images/large/1.jpg saved to cache
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d007b6b-6082-554a-8020-9b0aa78d8841
2026-03-24 18:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d007b6b-6082-554a-8020-9b0aa78d8841, skipping ID generation
2026-03-24 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d007b6b-6082-554a-8020-9b0aa78d8841 with scrape type 1
2026-03-24 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d007b6b-6082-554a-8020-9b0aa78d8841 sending to next pipeline
2026-03-24 18:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7d007b6b-6082-554a-8020-9b0aa78d8841, identifier: 1981275
2026-03-24 18:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7119d0>
2026-03-24 18:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_834e79af-cb13-5d50-beea-dd17860c7862/834e79af-cb13-5d50-beea-dd17860c7862_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252F965b123cc2ec4ab0b27cb59f813fadda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/965b123cc2ec4ab0b27cb59f813fadda/images/large/1.jpg saved to cache
2026-03-24 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 834e79af-cb13-5d50-beea-dd17860c7862
2026-03-24 18:32:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 834e79af-cb13-5d50-beea-dd17860c7862, skipping ID generation
2026-03-24 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834e79af-cb13-5d50-beea-dd17860c7862 with scrape type 1
2026-03-24 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 834e79af-cb13-5d50-beea-dd17860c7862 sending to next pipeline
2026-03-24 18:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 834e79af-cb13-5d50-beea-dd17860c7862, identifier: 1981276
2026-03-24 18:32:04 [ayvens.es] INFO: Found listing with ID: 1981284
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981284%27 HTTP/1.1" 200 None
2026-03-24 18:32:04 [ayvens.es] INFO: Scrape type for 1981284: 1
2026-03-24 18:32:04 [ayvens.es] INFO: Extracting data for car ID: 1981284
2026-03-24 18:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1981284
2026-03-24 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with scrape type 1
2026-03-24 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252F699a30804f2c43839d04899efc1e3111%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/699a30804f2c43839d04899efc1e3111/images/large/1.jpg not downloaded yet
2026-03-24 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1981272
2026-03-24 18:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1981272
2026-03-24 18:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1981272 to the API
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/803/7e752f412b70444cb691be2b02cd000a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f8d31e8b-d6e7-5ef5-9266-6698f58b02ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 133368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8d31e8b-d6e7-5ef5-9266-6698f58b02ea/f8d31e8b-d6e7-5ef5-9266-6698f58b02ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/803/7e752f412b70444cb691be2b02cd000a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 75KW (100CV) S&S Live Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 75KW (100CV) S&S Live Pack',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981272%27 HTTP/1.1" 200 None
2026-03-24 18:32:04 [ayvens.es] INFO: Saving data for 1981272: {'created_time': 1774377124.487737, 'last_price_update_time': 1774377124.487749, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981272') HTTP/1.1" 204 0
2026-03-24 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1981274
2026-03-24 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1981274
2026-03-24 18:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1981274 to the API
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/543/44df6f42ac13427f8381ce8d91c4a21b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Grafito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '701736a7-8a18-59cb-af86-0eab0d5edb3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 100909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701736a7-8a18-59cb-af86-0eab0d5edb3a/701736a7-8a18-59cb-af86-0eab0d5edb3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/543/44df6f42ac13427f8381ce8d91c4a21b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 220 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 220 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981274%27 HTTP/1.1" 200 None
2026-03-24 18:32:05 [ayvens.es] INFO: Saving data for 1981274: {'created_time': 1774377125.105838, 'last_price_update_time': 1774377125.10585, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981274') HTTP/1.1" 204 0
2026-03-24 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7d007b6b-6082-554a-8020-9b0aa78d8841 with identifier: 1981275
2026-03-24 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7d007b6b-6082-554a-8020-9b0aa78d8841 with identifier: 1981275
2026-03-24 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7d007b6b-6082-554a-8020-9b0aa78d8841 with identifier: 1981275 to the API
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/110/e84d708cd78e42d69de9cca3324c3624/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Perennial grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7d007b6b-6082-554a-8020-9b0aa78d8841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 84126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d007b6b-6082-554a-8020-9b0aa78d8841/7d007b6b-6082-554a-8020-9b0aa78d8841_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/110/e84d708cd78e42d69de9cca3324c3624/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981275%27 HTTP/1.1" 200 None
2026-03-24 18:32:05 [ayvens.es] INFO: Saving data for 1981275: {'created_time': 1774377125.66423, 'last_price_update_time': 1774377125.664242, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981275') HTTP/1.1" 204 0
2026-03-24 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 834e79af-cb13-5d50-beea-dd17860c7862 with identifier: 1981276
2026-03-24 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 834e79af-cb13-5d50-beea-dd17860c7862 with identifier: 1981276
2026-03-24 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 834e79af-cb13-5d50-beea-dd17860c7862 with identifier: 1981276 to the API
2026-03-24 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/090/965b123cc2ec4ab0b27cb59f813fadda/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco digital',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '834e79af-cb13-5d50-beea-dd17860c7862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 48506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_834e79af-cb13-5d50-beea-dd17860c7862/834e79af-cb13-5d50-beea-dd17860c7862_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/090/965b123cc2ec4ab0b27cb59f813fadda/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT Shooting Brake',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981276%27 HTTP/1.1" 200 None
2026-03-24 18:32:06 [ayvens.es] INFO: Saving data for 1981276: {'created_time': 1774377126.134049, 'last_price_update_time': 1774377126.134059, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981276') HTTP/1.1" 204 0
2026-03-24 18:32:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 3 pages/min), scraped 162 items (at 104 items/min)
2026-03-24 18:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-24 18:32:06 [ayvens.es] INFO: Found listing with ID: 1981285
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981285%27 HTTP/1.1" 200 None
2026-03-24 18:32:06 [ayvens.es] INFO: Scrape type for 1981285: 1
2026-03-24 18:32:06 [ayvens.es] INFO: Extracting data for car ID: 1981285
2026-03-24 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1981285
2026-03-24 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37231ca2-b1c8-5ed9-b159-6e9270285542 with scrape type 1
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37231ca2-b1c8-5ed9-b159-6e9270285542
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252F970581f89d734505867fd322d2281015%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/970581f89d734505867fd322d2281015/images/large/1.jpg not downloaded yet
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1de010>
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2065a08-b765-5a2c-a1c1-9441b54dd62d/b2065a08-b765-5a2c-a1c1-9441b54dd62d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F05e90bce65064cb9b9981bb04fe80c78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/05e90bce65064cb9b9981bb04fe80c78/images/large/1.jpg saved to cache
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2065a08-b765-5a2c-a1c1-9441b54dd62d
2026-03-24 18:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2065a08-b765-5a2c-a1c1-9441b54dd62d, skipping ID generation
2026-03-24 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2065a08-b765-5a2c-a1c1-9441b54dd62d with scrape type 1
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2065a08-b765-5a2c-a1c1-9441b54dd62d sending to next pipeline
2026-03-24 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2065a08-b765-5a2c-a1c1-9441b54dd62d, identifier: 1981273
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb0e850>
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8/b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F764%252Ffe8b29bc87094a61850028ed0db5f6f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/764/fe8b29bc87094a61850028ed0db5f6f3/images/large/1.jpg saved to cache
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8
2026-03-24 18:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8, skipping ID generation
2026-03-24 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with scrape type 1
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 sending to next pipeline
2026-03-24 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8, identifier: 1981277
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6cfbd0>
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14/c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F2e0dd67c36e74e2887efe0264a570413%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/2e0dd67c36e74e2887efe0264a570413/images/large/1.jpg saved to cache
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14
2026-03-24 18:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14, skipping ID generation
2026-03-24 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with scrape type 1
2026-03-24 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 sending to next pipeline
2026-03-24 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14, identifier: 1981278
2026-03-24 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/138/b05b8579aaa44cd282c9a888a4f2dd83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1981273
2026-03-24 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1981273
2026-03-24 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1981273 to the API
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/531/05e90bce65064cb9b9981bb04fe80c78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata perla moondust',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2065a08-b765-5a2c-a1c1-9441b54dd62d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 60005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2065a08-b765-5a2c-a1c1-9441b54dd62d/b2065a08-b765-5a2c-a1c1-9441b54dd62d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/531/05e90bce65064cb9b9981bb04fe80c78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981273%27 HTTP/1.1" 200 None
2026-03-24 18:32:07 [ayvens.es] INFO: Saving data for 1981273: {'created_time': 1774377127.31327, 'last_price_update_time': 1774377127.313283, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981273') HTTP/1.1" 204 0
2026-03-24 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1981277
2026-03-24 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1981277
2026-03-24 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1981277 to the API
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/764/fe8b29bc87094a61850028ed0db5f6f3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco metropoli',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 137564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8/b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/764/fe8b29bc87094a61850028ed0db5f6f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981277%27 HTTP/1.1" 200 None
2026-03-24 18:32:07 [ayvens.es] INFO: Saving data for 1981277: {'created_time': 1774377127.623359, 'last_price_update_time': 1774377127.623371, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981277') HTTP/1.1" 204 0
2026-03-24 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1981278
2026-03-24 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1981278
2026-03-24 18:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1981278 to the API
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/415/2e0dd67c36e74e2887efe0264a570413/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'A',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 88646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14/c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/415/2e0dd67c36e74e2887efe0264a570413/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981278%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [ayvens.es] INFO: Saving data for 1981278: {'created_time': 1774377128.210754, 'last_price_update_time': 1774377128.210764, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981278') HTTP/1.1" 204 0
2026-03-24 18:32:08 [ayvens.es] INFO: Found listing with ID: 1981286
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981286%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [ayvens.es] INFO: Scrape type for 1981286: 1
2026-03-24 18:32:08 [ayvens.es] INFO: Extracting data for car ID: 1981286
2026-03-24 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1981286
2026-03-24 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a481262-8a12-5a10-b357-0fd22e1d589a with scrape type 1
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9a481262-8a12-5a10-b357-0fd22e1d589a
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252Fc927a56a58954eccaf3189c2dd8ff4e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/c927a56a58954eccaf3189c2dd8ff4e5/images/large/1.jpg not downloaded yet
2026-03-24 18:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/250/eb639246b11d46e8b7599ed01b3343ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/567/dbbc7bccd60540aba194d65e3ca7b575/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:08 [ayvens.es] INFO: Found listing with ID: 1981287
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981287%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [ayvens.es] INFO: Scrape type for 1981287: 1
2026-03-24 18:32:08 [ayvens.es] INFO: Extracting data for car ID: 1981287
2026-03-24 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1981287
2026-03-24 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ec1aa9-25d0-549f-81c1-9085d90a8570 with scrape type 1
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 80ec1aa9-25d0-549f-81c1-9085d90a8570
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252F30d80cb3399343b6ba9b739d0c23019a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/30d80cb3399343b6ba9b739d0c23019a/images/large/1.jpg not downloaded yet
2026-03-24 18:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7d50d0>
2026-03-24 18:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bf23cb-9e65-5a55-9197-e8a828180e6c/01bf23cb-9e65-5a55-9197-e8a828180e6c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F138%252Fb05b8579aaa44cd282c9a888a4f2dd83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/138/b05b8579aaa44cd282c9a888a4f2dd83/images/large/1.jpg saved to cache
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01bf23cb-9e65-5a55-9197-e8a828180e6c
2026-03-24 18:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01bf23cb-9e65-5a55-9197-e8a828180e6c, skipping ID generation
2026-03-24 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bf23cb-9e65-5a55-9197-e8a828180e6c with scrape type 1
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01bf23cb-9e65-5a55-9197-e8a828180e6c sending to next pipeline
2026-03-24 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 01bf23cb-9e65-5a55-9197-e8a828180e6c, identifier: 1981279
2026-03-24 18:32:08 [ayvens.es] INFO: Found listing with ID: 1981288
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981288%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [ayvens.es] INFO: Scrape type for 1981288: 1
2026-03-24 18:32:08 [ayvens.es] INFO: Extracting data for car ID: 1981288
2026-03-24 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a08a57c-03d0-5e57-b514-f2b2b9d11544 with identifier: 1981288
2026-03-24 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a08a57c-03d0-5e57-b514-f2b2b9d11544 with scrape type 1
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a08a57c-03d0-5e57-b514-f2b2b9d11544
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252Ff41d25104d5a4c558c4aebf84a5e50fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/f41d25104d5a4c558c4aebf84a5e50fd/images/large/1.jpg not downloaded yet
2026-03-24 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1981279
2026-03-24 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1981279
2026-03-24 18:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1981279 to the API
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/138/b05b8579aaa44cd282c9a888a4f2dd83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Negro noche',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '01bf23cb-9e65-5a55-9197-e8a828180e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 94165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bf23cb-9e65-5a55-9197-e8a828180e6c/01bf23cb-9e65-5a55-9197-e8a828180e6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/138/b05b8579aaa44cd282c9a888a4f2dd83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981279%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [ayvens.es] INFO: Saving data for 1981279: {'created_time': 1774377128.937009, 'last_price_update_time': 1774377128.93702, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981279') HTTP/1.1" 204 0
2026-03-24 18:32:08 [ayvens.es] INFO: Found listing with ID: 1981289
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981289%27 HTTP/1.1" 200 None
2026-03-24 18:32:08 [ayvens.es] INFO: Scrape type for 1981289: 1
2026-03-24 18:32:08 [ayvens.es] INFO: Extracting data for car ID: 1981289
2026-03-24 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f602132b-c7f1-527c-a102-076d8ee3bb93 with identifier: 1981289
2026-03-24 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f602132b-c7f1-527c-a102-076d8ee3bb93 with scrape type 1
2026-03-24 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f602132b-c7f1-527c-a102-076d8ee3bb93
2026-03-24 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F86f162096dc049d996ad1effa2509e9e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/86f162096dc049d996ad1effa2509e9e/images/large/1.jpg not downloaded yet
2026-03-24 18:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/767/8985140d65e743a8b0fdf37e1131eb3e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/336/a7c0f5585c7d4ef9a3b0f05d6b4fb034/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef68790>
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0266cc-6634-5889-8355-e710f4b61f0c/2e0266cc-6634-5889-8355-e710f4b61f0c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F250%252Feb639246b11d46e8b7599ed01b3343ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/250/eb639246b11d46e8b7599ed01b3343ea/images/large/1.jpg saved to cache
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e0266cc-6634-5889-8355-e710f4b61f0c
2026-03-24 18:32:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e0266cc-6634-5889-8355-e710f4b61f0c, skipping ID generation
2026-03-24 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0266cc-6634-5889-8355-e710f4b61f0c with scrape type 1
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e0266cc-6634-5889-8355-e710f4b61f0c sending to next pipeline
2026-03-24 18:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2e0266cc-6634-5889-8355-e710f4b61f0c, identifier: 1981281
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed42490>
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8/e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fdbbc7bccd60540aba194d65e3ca7b575%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/dbbc7bccd60540aba194d65e3ca7b575/images/large/1.jpg saved to cache
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8
2026-03-24 18:32:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8, skipping ID generation
2026-03-24 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with scrape type 1
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 sending to next pipeline
2026-03-24 18:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8, identifier: 1981280
2026-03-24 18:32:09 [ayvens.es] INFO: Found listing with ID: 1981290
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981290%27 HTTP/1.1" 200 None
2026-03-24 18:32:09 [ayvens.es] INFO: Scrape type for 1981290: 1
2026-03-24 18:32:09 [ayvens.es] INFO: Extracting data for car ID: 1981290
2026-03-24 18:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1981290
2026-03-24 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43098c7-96d2-51ff-b01b-b43200cd6323 with scrape type 1
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b43098c7-96d2-51ff-b01b-b43200cd6323
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fda5a759f128440f1b84d3a4c12406d0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/da5a759f128440f1b84d3a4c12406d0d/images/large/1.jpg not downloaded yet
2026-03-24 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2e0266cc-6634-5889-8355-e710f4b61f0c with identifier: 1981281
2026-03-24 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2e0266cc-6634-5889-8355-e710f4b61f0c with identifier: 1981281
2026-03-24 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2e0266cc-6634-5889-8355-e710f4b61f0c with identifier: 1981281 to the API
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/250/eb639246b11d46e8b7599ed01b3343ea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2e0266cc-6634-5889-8355-e710f4b61f0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 47957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0266cc-6634-5889-8355-e710f4b61f0c/2e0266cc-6634-5889-8355-e710f4b61f0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/250/eb639246b11d46e8b7599ed01b3343ea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 TGDI 169kW HEV Tecno Auto 2C',
 'transmission': 'manual',
 'trim': '1.6 TGDI 169kW HEV Tecno Auto 2C',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981281%27 HTTP/1.1" 200 None
2026-03-24 18:32:09 [ayvens.es] INFO: Saving data for 1981281: {'created_time': 1774377129.676568, 'last_price_update_time': 1774377129.676578, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981281') HTTP/1.1" 204 0
2026-03-24 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1981280
2026-03-24 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1981280
2026-03-24 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1981280 to the API
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/567/dbbc7bccd60540aba194d65e3ca7b575/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Pintura blanca s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 46872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8/e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/dbbc7bccd60540aba194d65e3ca7b575/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Tecno DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Tecno DCT',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981280%27 HTTP/1.1" 200 None
2026-03-24 18:32:09 [ayvens.es] INFO: Saving data for 1981280: {'created_time': 1774377129.9596, 'last_price_update_time': 1774377129.959611, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981280') HTTP/1.1" 204 0
2026-03-24 18:32:09 [ayvens.es] INFO: Found listing with ID: 1981291
2026-03-24 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981291%27 HTTP/1.1" 200 None
2026-03-24 18:32:10 [ayvens.es] INFO: Scrape type for 1981291: 1
2026-03-24 18:32:10 [ayvens.es] INFO: Extracting data for car ID: 1981291
2026-03-24 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e19100f-0c2a-5fea-bac8-6f104e36d1ed with identifier: 1981291
2026-03-24 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e19100f-0c2a-5fea-bac8-6f104e36d1ed with scrape type 1
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e19100f-0c2a-5fea-bac8-6f104e36d1ed
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F807%252Fde13f5d8672a4529832aa111f9a184d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/807/de13f5d8672a4529832aa111f9a184d5/images/large/1.jpg not downloaded yet
2026-03-24 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/937/699a30804f2c43839d04899efc1e3111/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef69f90>
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f436c9e-9717-5a70-a3ab-24b3b10ddf27/1f436c9e-9717-5a70-a3ab-24b3b10ddf27_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F767%252F8985140d65e743a8b0fdf37e1131eb3e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/767/8985140d65e743a8b0fdf37e1131eb3e/images/large/1.jpg saved to cache
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f436c9e-9717-5a70-a3ab-24b3b10ddf27
2026-03-24 18:32:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f436c9e-9717-5a70-a3ab-24b3b10ddf27, skipping ID generation
2026-03-24 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f436c9e-9717-5a70-a3ab-24b3b10ddf27 with scrape type 1
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f436c9e-9717-5a70-a3ab-24b3b10ddf27 sending to next pipeline
2026-03-24 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f436c9e-9717-5a70-a3ab-24b3b10ddf27, identifier: 1981283
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0fcbd0>
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab807c69-ed34-54f3-b7d2-7914be56a415/ab807c69-ed34-54f3-b7d2-7914be56a415_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fa7c0f5585c7d4ef9a3b0f05d6b4fb034%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/a7c0f5585c7d4ef9a3b0f05d6b4fb034/images/large/1.jpg saved to cache
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab807c69-ed34-54f3-b7d2-7914be56a415
2026-03-24 18:32:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab807c69-ed34-54f3-b7d2-7914be56a415, skipping ID generation
2026-03-24 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab807c69-ed34-54f3-b7d2-7914be56a415 with scrape type 1
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab807c69-ed34-54f3-b7d2-7914be56a415 sending to next pipeline
2026-03-24 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab807c69-ed34-54f3-b7d2-7914be56a415, identifier: 1981282
2026-03-24 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/249/970581f89d734505867fd322d2281015/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:10 [ayvens.es] INFO: Found listing with ID: 1981292
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981292%27 HTTP/1.1" 200 None
2026-03-24 18:32:10 [ayvens.es] INFO: Scrape type for 1981292: 1
2026-03-24 18:32:10 [ayvens.es] INFO: Extracting data for car ID: 1981292
2026-03-24 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1981292
2026-03-24 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5f805e-e58f-540d-a28b-ecc243d5733c with scrape type 1
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2d5f805e-e58f-540d-a28b-ecc243d5733c
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F109%252F45787f6b7ef3432da033d3d1a76ed69f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/109/45787f6b7ef3432da033d3d1a76ed69f/images/large/1.jpg not downloaded yet
2026-03-24 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f436c9e-9717-5a70-a3ab-24b3b10ddf27 with identifier: 1981283
2026-03-24 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f436c9e-9717-5a70-a3ab-24b3b10ddf27 with identifier: 1981283
2026-03-24 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f436c9e-9717-5a70-a3ab-24b3b10ddf27 with identifier: 1981283 to the API
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/767/8985140d65e743a8b0fdf37e1131eb3e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1f436c9e-9717-5a70-a3ab-24b3b10ddf27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 78013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f436c9e-9717-5a70-a3ab-24b3b10ddf27/1f436c9e-9717-5a70-a3ab-24b3b10ddf27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/767/8985140d65e743a8b0fdf37e1131eb3e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981283%27 HTTP/1.1" 200 None
2026-03-24 18:32:10 [ayvens.es] INFO: Saving data for 1981283: {'created_time': 1774377130.770504, 'last_price_update_time': 1774377130.77053, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981283') HTTP/1.1" 204 0
2026-03-24 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1981282
2026-03-24 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1981282
2026-03-24 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1981282 to the API
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/336/a7c0f5585c7d4ef9a3b0f05d6b4fb034/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab807c69-ed34-54f3-b7d2-7914be56a415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 77681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab807c69-ed34-54f3-b7d2-7914be56a415/ab807c69-ed34-54f3-b7d2-7914be56a415_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/a7c0f5585c7d4ef9a3b0f05d6b4fb034/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981282%27 HTTP/1.1" 200 None
2026-03-24 18:32:11 [ayvens.es] INFO: Saving data for 1981282: {'created_time': 1774377131.053759, 'last_price_update_time': 1774377131.05377, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981282') HTTP/1.1" 204 0
2026-03-24 18:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/428/30d80cb3399343b6ba9b739d0c23019a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:11 [ayvens.es] INFO: Found listing with ID: 1981293
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981293%27 HTTP/1.1" 200 None
2026-03-24 18:32:11 [ayvens.es] INFO: Scrape type for 1981293: 1
2026-03-24 18:32:11 [ayvens.es] INFO: Extracting data for car ID: 1981293
2026-03-24 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1981293
2026-03-24 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with scrape type 1
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F019358d0ca734256b198956e14e165e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/019358d0ca734256b198956e14e165e5/images/large/1.jpg not downloaded yet
2026-03-24 18:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/962/c927a56a58954eccaf3189c2dd8ff4e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef5d590>
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698/8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252F699a30804f2c43839d04899efc1e3111%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/699a30804f2c43839d04899efc1e3111/images/large/1.jpg saved to cache
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698
2026-03-24 18:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698, skipping ID generation
2026-03-24 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with scrape type 1
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 sending to next pipeline
2026-03-24 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698, identifier: 1981284
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0600290>
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37231ca2-b1c8-5ed9-b159-6e9270285542/37231ca2-b1c8-5ed9-b159-6e9270285542_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252F970581f89d734505867fd322d2281015%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/970581f89d734505867fd322d2281015/images/large/1.jpg saved to cache
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37231ca2-b1c8-5ed9-b159-6e9270285542
2026-03-24 18:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37231ca2-b1c8-5ed9-b159-6e9270285542, skipping ID generation
2026-03-24 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37231ca2-b1c8-5ed9-b159-6e9270285542 with scrape type 1
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37231ca2-b1c8-5ed9-b159-6e9270285542 sending to next pipeline
2026-03-24 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 37231ca2-b1c8-5ed9-b159-6e9270285542, identifier: 1981285
2026-03-24 18:32:11 [ayvens.es] INFO: Found listing with ID: 1981294
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981294%27 HTTP/1.1" 200 None
2026-03-24 18:32:11 [ayvens.es] INFO: Scrape type for 1981294: 1
2026-03-24 18:32:11 [ayvens.es] INFO: Extracting data for car ID: 1981294
2026-03-24 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aac65dc-e2e0-5a18-8681-7b469672db5a with identifier: 1981294
2026-03-24 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aac65dc-e2e0-5a18-8681-7b469672db5a with scrape type 1
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8aac65dc-e2e0-5a18-8681-7b469672db5a
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F429%252F18471555e01540ccb9abb6052b6b57ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/429/18471555e01540ccb9abb6052b6b57ff/images/large/1.jpg not downloaded yet
2026-03-24 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1981284
2026-03-24 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1981284
2026-03-24 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1981284 to the API
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/937/699a30804f2c43839d04899efc1e3111/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 90122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698/8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/937/699a30804f2c43839d04899efc1e3111/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981284%27 HTTP/1.1" 200 None
2026-03-24 18:32:11 [ayvens.es] INFO: Saving data for 1981284: {'created_time': 1774377131.836531, 'last_price_update_time': 1774377131.836541, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981284') HTTP/1.1" 204 0
2026-03-24 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1981285
2026-03-24 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1981285
2026-03-24 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1981285 to the API
2026-03-24 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/249/970581f89d734505867fd322d2281015/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '37231ca2-b1c8-5ed9-b159-6e9270285542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 37317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37231ca2-b1c8-5ed9-b159-6e9270285542/37231ca2-b1c8-5ed9-b159-6e9270285542_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/249/970581f89d734505867fd322d2281015/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981285%27 HTTP/1.1" 200 None
2026-03-24 18:32:12 [ayvens.es] INFO: Saving data for 1981285: {'created_time': 1774377132.24603, 'last_price_update_time': 1774377132.246041, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981285') HTTP/1.1" 204 0
2026-03-24 18:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/204/f41d25104d5a4c558c4aebf84a5e50fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:12 [ayvens.es] INFO: Found listing with ID: 1981295
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981295%27 HTTP/1.1" 200 None
2026-03-24 18:32:12 [ayvens.es] INFO: Scrape type for 1981295: 1
2026-03-24 18:32:12 [ayvens.es] INFO: Extracting data for car ID: 1981295
2026-03-24 18:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 194f51c1-0bfa-560b-8bf3-e02691a50e1d with identifier: 1981295
2026-03-24 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194f51c1-0bfa-560b-8bf3-e02691a50e1d with scrape type 1
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 194f51c1-0bfa-560b-8bf3-e02691a50e1d
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F725%252F80b19d5fba1a47a5a09ac620af8b9c73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/725/80b19d5fba1a47a5a09ac620af8b9c73/images/large/1.jpg not downloaded yet
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8593d0>
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80ec1aa9-25d0-549f-81c1-9085d90a8570/80ec1aa9-25d0-549f-81c1-9085d90a8570_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252F30d80cb3399343b6ba9b739d0c23019a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/30d80cb3399343b6ba9b739d0c23019a/images/large/1.jpg saved to cache
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80ec1aa9-25d0-549f-81c1-9085d90a8570
2026-03-24 18:32:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80ec1aa9-25d0-549f-81c1-9085d90a8570, skipping ID generation
2026-03-24 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ec1aa9-25d0-549f-81c1-9085d90a8570 with scrape type 1
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80ec1aa9-25d0-549f-81c1-9085d90a8570 sending to next pipeline
2026-03-24 18:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 80ec1aa9-25d0-549f-81c1-9085d90a8570, identifier: 1981287
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecf3d10>
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a481262-8a12-5a10-b357-0fd22e1d589a/9a481262-8a12-5a10-b357-0fd22e1d589a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252Fc927a56a58954eccaf3189c2dd8ff4e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/c927a56a58954eccaf3189c2dd8ff4e5/images/large/1.jpg saved to cache
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a481262-8a12-5a10-b357-0fd22e1d589a
2026-03-24 18:32:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a481262-8a12-5a10-b357-0fd22e1d589a, skipping ID generation
2026-03-24 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a481262-8a12-5a10-b357-0fd22e1d589a with scrape type 1
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a481262-8a12-5a10-b357-0fd22e1d589a sending to next pipeline
2026-03-24 18:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9a481262-8a12-5a10-b357-0fd22e1d589a, identifier: 1981286
2026-03-24 18:32:12 [ayvens.es] INFO: Found listing with ID: 1981296
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981296%27 HTTP/1.1" 200 None
2026-03-24 18:32:12 [ayvens.es] INFO: Scrape type for 1981296: 1
2026-03-24 18:32:12 [ayvens.es] INFO: Extracting data for car ID: 1981296
2026-03-24 18:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1981296
2026-03-24 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42879ed-87df-5183-a6ac-7b1711dfa501 with scrape type 1
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e42879ed-87df-5183-a6ac-7b1711dfa501
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F653%252F2830b32ac5af4ba5abc7b88748112e46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/653/2830b32ac5af4ba5abc7b88748112e46/images/large/1.jpg not downloaded yet
2026-03-24 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1981287
2026-03-24 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1981287
2026-03-24 18:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1981287 to the API
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/428/30d80cb3399343b6ba9b739d0c23019a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Arktis white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '80ec1aa9-25d0-549f-81c1-9085d90a8570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 44250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80ec1aa9-25d0-549f-81c1-9085d90a8570/80ec1aa9-25d0-549f-81c1-9085d90a8570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/428/30d80cb3399343b6ba9b739d0c23019a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA 1.2 T 100kW (136 CV) GS',
 'transmission': 'manual',
 'trim': '1.2 T 100kW (136 CV) GS',
 'vin': None,
 'year': 2024}
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981287%27 HTTP/1.1" 200 None
2026-03-24 18:32:12 [ayvens.es] INFO: Saving data for 1981287: {'created_time': 1774377132.928691, 'last_price_update_time': 1774377132.928701, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981287') HTTP/1.1" 204 0
2026-03-24 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1981286
2026-03-24 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1981286
2026-03-24 18:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1981286 to the API
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/962/c927a56a58954eccaf3189c2dd8ff4e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Phytonic blau metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9a481262-8a12-5a10-b357-0fd22e1d589a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 97551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a481262-8a12-5a10-b357-0fd22e1d589a/9a481262-8a12-5a10-b357-0fd22e1d589a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/962/c927a56a58954eccaf3189c2dd8ff4e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20i',
 'transmission': 'manual',
 'trim': 'xDrive20i',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981286%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [ayvens.es] INFO: Saving data for 1981286: {'created_time': 1774377133.291096, 'last_price_update_time': 1774377133.291109, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981286') HTTP/1.1" 204 0
2026-03-24 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/820/86f162096dc049d996ad1effa2509e9e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/da5a759f128440f1b84d3a4c12406d0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:13 [ayvens.es] INFO: Found listing with ID: 1981297
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981297%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [ayvens.es] INFO: Scrape type for 1981297: 1
2026-03-24 18:32:13 [ayvens.es] INFO: Extracting data for car ID: 1981297
2026-03-24 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1981297
2026-03-24 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with scrape type 1
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252F601bbe5ee5624b35a1d8bf6e5d1514f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/601bbe5ee5624b35a1d8bf6e5d1514f8/images/large/1.jpg not downloaded yet
2026-03-24 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/109/45787f6b7ef3432da033d3d1a76ed69f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e1cd0>
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a08a57c-03d0-5e57-b514-f2b2b9d11544/1a08a57c-03d0-5e57-b514-f2b2b9d11544_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252Ff41d25104d5a4c558c4aebf84a5e50fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/f41d25104d5a4c558c4aebf84a5e50fd/images/large/1.jpg saved to cache
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a08a57c-03d0-5e57-b514-f2b2b9d11544
2026-03-24 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a08a57c-03d0-5e57-b514-f2b2b9d11544, skipping ID generation
2026-03-24 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a08a57c-03d0-5e57-b514-f2b2b9d11544 with scrape type 1
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a08a57c-03d0-5e57-b514-f2b2b9d11544 sending to next pipeline
2026-03-24 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a08a57c-03d0-5e57-b514-f2b2b9d11544, identifier: 1981288
2026-03-24 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/807/de13f5d8672a4529832aa111f9a184d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:13 [ayvens.es] INFO: Found listing with ID: 1981298
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981298%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [ayvens.es] INFO: Scrape type for 1981298: 1
2026-03-24 18:32:13 [ayvens.es] INFO: Extracting data for car ID: 1981298
2026-03-24 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3f37323-ef0f-549c-b3bf-f2daf8944e53 with identifier: 1981298
2026-03-24 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f37323-ef0f-549c-b3bf-f2daf8944e53 with scrape type 1
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3f37323-ef0f-549c-b3bf-f2daf8944e53
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252F1d5d8a0716c74324b6c75d70996ef6ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/1d5d8a0716c74324b6c75d70996ef6ef/images/large/1.jpg not downloaded yet
2026-03-24 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a08a57c-03d0-5e57-b514-f2b2b9d11544 with identifier: 1981288
2026-03-24 18:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a08a57c-03d0-5e57-b514-f2b2b9d11544 with identifier: 1981288
2026-03-24 18:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1a08a57c-03d0-5e57-b514-f2b2b9d11544 with identifier: 1981288 to the API
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/204/f41d25104d5a4c558c4aebf84a5e50fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1a08a57c-03d0-5e57-b514-f2b2b9d11544',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'ECOSPORT',
 'odometer': 102697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a08a57c-03d0-5e57-b514-f2b2b9d11544/1a08a57c-03d0-5e57-b514-f2b2b9d11544_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/204/f41d25104d5a4c558c4aebf84a5e50fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD ECOSPORT 1.0T EcoBoost 92kW (125CV) S&S Trend',
 'transmission': 'manual',
 'trim': '1.0T EcoBoost 92kW (125CV) S&S Trend',
 'vin': None,
 'year': 2019}
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981288%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [ayvens.es] INFO: Saving data for 1981288: {'created_time': 1774377133.883526, 'last_price_update_time': 1774377133.883536, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981288') HTTP/1.1" 204 0
2026-03-24 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/933/019358d0ca734256b198956e14e165e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:13 [ayvens.es] INFO: Found listing with ID: 1981299
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981299%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [ayvens.es] INFO: Scrape type for 1981299: 1
2026-03-24 18:32:13 [ayvens.es] INFO: Extracting data for car ID: 1981299
2026-03-24 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1981299
2026-03-24 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af79901b-e417-59cb-ac68-74b390473166 with scrape type 1
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af79901b-e417-59cb-ac68-74b390473166
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252Fa214ea335a2149549920c23d522cabd3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/a214ea335a2149549920c23d522cabd3/images/large/1.jpg not downloaded yet
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee25b690>
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f602132b-c7f1-527c-a102-076d8ee3bb93/f602132b-c7f1-527c-a102-076d8ee3bb93_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F86f162096dc049d996ad1effa2509e9e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/86f162096dc049d996ad1effa2509e9e/images/large/1.jpg saved to cache
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f602132b-c7f1-527c-a102-076d8ee3bb93
2026-03-24 18:32:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f602132b-c7f1-527c-a102-076d8ee3bb93, skipping ID generation
2026-03-24 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f602132b-c7f1-527c-a102-076d8ee3bb93 with scrape type 1
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f602132b-c7f1-527c-a102-076d8ee3bb93 sending to next pipeline
2026-03-24 18:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f602132b-c7f1-527c-a102-076d8ee3bb93, identifier: 1981289
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1d4990>
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b43098c7-96d2-51ff-b01b-b43200cd6323/b43098c7-96d2-51ff-b01b-b43200cd6323_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fda5a759f128440f1b84d3a4c12406d0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/da5a759f128440f1b84d3a4c12406d0d/images/large/1.jpg saved to cache
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b43098c7-96d2-51ff-b01b-b43200cd6323
2026-03-24 18:32:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b43098c7-96d2-51ff-b01b-b43200cd6323, skipping ID generation
2026-03-24 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43098c7-96d2-51ff-b01b-b43200cd6323 with scrape type 1
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b43098c7-96d2-51ff-b01b-b43200cd6323 sending to next pipeline
2026-03-24 18:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b43098c7-96d2-51ff-b01b-b43200cd6323, identifier: 1981290
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7c61d0>
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d5f805e-e58f-540d-a28b-ecc243d5733c/2d5f805e-e58f-540d-a28b-ecc243d5733c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F109%252F45787f6b7ef3432da033d3d1a76ed69f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/109/45787f6b7ef3432da033d3d1a76ed69f/images/large/1.jpg saved to cache
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d5f805e-e58f-540d-a28b-ecc243d5733c
2026-03-24 18:32:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d5f805e-e58f-540d-a28b-ecc243d5733c, skipping ID generation
2026-03-24 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5f805e-e58f-540d-a28b-ecc243d5733c with scrape type 1
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d5f805e-e58f-540d-a28b-ecc243d5733c sending to next pipeline
2026-03-24 18:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2d5f805e-e58f-540d-a28b-ecc243d5733c, identifier: 1981292
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a1250>
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e19100f-0c2a-5fea-bac8-6f104e36d1ed/4e19100f-0c2a-5fea-bac8-6f104e36d1ed_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F807%252Fde13f5d8672a4529832aa111f9a184d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/807/de13f5d8672a4529832aa111f9a184d5/images/large/1.jpg saved to cache
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e19100f-0c2a-5fea-bac8-6f104e36d1ed
2026-03-24 18:32:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e19100f-0c2a-5fea-bac8-6f104e36d1ed, skipping ID generation
2026-03-24 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e19100f-0c2a-5fea-bac8-6f104e36d1ed with scrape type 1
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e19100f-0c2a-5fea-bac8-6f104e36d1ed sending to next pipeline
2026-03-24 18:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e19100f-0c2a-5fea-bac8-6f104e36d1ed, identifier: 1981291
2026-03-24 18:32:14 [ayvens.es] INFO: Found listing with ID: 1981300
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981300%27 HTTP/1.1" 200 None
2026-03-24 18:32:14 [ayvens.es] INFO: Scrape type for 1981300: 1
2026-03-24 18:32:14 [ayvens.es] INFO: Extracting data for car ID: 1981300
2026-03-24 18:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1981300
2026-03-24 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ec6bbc-1aa1-5380-b25a-338417e9c526 with scrape type 1
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89ec6bbc-1aa1-5380-b25a-338417e9c526
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Fa373b4d5a5194c97acbfbc065f3d4f19%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/a373b4d5a5194c97acbfbc065f3d4f19/images/large/1.jpg not downloaded yet
2026-03-24 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f602132b-c7f1-527c-a102-076d8ee3bb93 with identifier: 1981289
2026-03-24 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f602132b-c7f1-527c-a102-076d8ee3bb93 with identifier: 1981289
2026-03-24 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f602132b-c7f1-527c-a102-076d8ee3bb93 with identifier: 1981289 to the API
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/820/86f162096dc049d996ad1effa2509e9e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Plata solar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f602132b-c7f1-527c-a102-076d8ee3bb93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 64979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f602132b-c7f1-527c-a102-076d8ee3bb93/f602132b-c7f1-527c-a102-076d8ee3bb93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/820/86f162096dc049d996ad1effa2509e9e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line X 2.5 Duratec FHEV 140kW 4x4 Aut',
 'transmission': 'manual',
 'trim': 'ST-Line X 2.5 Duratec FHEV 140kW 4x4 Aut',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981289%27 HTTP/1.1" 200 None
2026-03-24 18:32:14 [ayvens.es] INFO: Saving data for 1981289: {'created_time': 1774377134.843847, 'last_price_update_time': 1774377134.84386, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981289') HTTP/1.1" 204 0
2026-03-24 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1981290
2026-03-24 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1981290
2026-03-24 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1981290 to the API
2026-03-24 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/da5a759f128440f1b84d3a4c12406d0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b43098c7-96d2-51ff-b01b-b43200cd6323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 47524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b43098c7-96d2-51ff-b01b-b43200cd6323/b43098c7-96d2-51ff-b01b-b43200cd6323_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/da5a759f128440f1b84d3a4c12406d0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': 'GLA 200 D+++Revisar peritacion+++',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981290%27 HTTP/1.1" 200 None
2026-03-24 18:32:15 [ayvens.es] INFO: Saving data for 1981290: {'created_time': 1774377135.13332, 'last_price_update_time': 1774377135.13333, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981290') HTTP/1.1" 204 0
2026-03-24 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1981292
2026-03-24 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1981292
2026-03-24 18:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1981292 to the API
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/109/45787f6b7ef3432da033d3d1a76ed69f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2d5f805e-e58f-540d-a28b-ecc243d5733c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 84856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d5f805e-e58f-540d-a28b-ecc243d5733c/2d5f805e-e58f-540d-a28b-ecc243d5733c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/109/45787f6b7ef3432da033d3d1a76ed69f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981292%27 HTTP/1.1" 200 None
2026-03-24 18:32:15 [ayvens.es] INFO: Saving data for 1981292: {'created_time': 1774377135.410513, 'last_price_update_time': 1774377135.410522, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981292') HTTP/1.1" 204 0
2026-03-24 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e19100f-0c2a-5fea-bac8-6f104e36d1ed with identifier: 1981291
2026-03-24 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e19100f-0c2a-5fea-bac8-6f104e36d1ed with identifier: 1981291
2026-03-24 18:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4e19100f-0c2a-5fea-bac8-6f104e36d1ed with identifier: 1981291 to the API
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/807/de13f5d8672a4529832aa111f9a184d5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4e19100f-0c2a-5fea-bac8-6f104e36d1ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 53417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e19100f-0c2a-5fea-bac8-6f104e36d1ed/4e19100f-0c2a-5fea-bac8-6f104e36d1ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/807/de13f5d8672a4529832aa111f9a184d5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 318d Auto.',
 'transmission': 'manual',
 'trim': '318d Auto.',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981291%27 HTTP/1.1" 200 None
2026-03-24 18:32:15 [ayvens.es] INFO: Saving data for 1981291: {'created_time': 1774377135.697961, 'last_price_update_time': 1774377135.697971, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981291') HTTP/1.1" 204 0
2026-03-24 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/429/18471555e01540ccb9abb6052b6b57ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/725/80b19d5fba1a47a5a09ac620af8b9c73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:15 [ayvens.es] INFO: Found listing with ID: 1981301
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981301%27 HTTP/1.1" 200 None
2026-03-24 18:32:15 [ayvens.es] INFO: Scrape type for 1981301: 1
2026-03-24 18:32:15 [ayvens.es] INFO: Extracting data for car ID: 1981301
2026-03-24 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1981301
2026-03-24 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with scrape type 1
2026-03-24 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F25308ba53ca34313823f21cb75682e8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/25308ba53ca34313823f21cb75682e8b/images/large/1.jpg not downloaded yet
2026-03-24 18:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1e53d0>
2026-03-24 18:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6/ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F019358d0ca734256b198956e14e165e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/019358d0ca734256b198956e14e165e5/images/large/1.jpg saved to cache
2026-03-24 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6
2026-03-24 18:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6, skipping ID generation
2026-03-24 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with scrape type 1
2026-03-24 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 sending to next pipeline
2026-03-24 18:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6, identifier: 1981293
2026-03-24 18:32:15 [ayvens.es] INFO: Found listing with ID: 1981302
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981302%27 HTTP/1.1" 200 None
2026-03-24 18:32:15 [ayvens.es] INFO: Scrape type for 1981302: 1
2026-03-24 18:32:15 [ayvens.es] INFO: Extracting data for car ID: 1981302
2026-03-24 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1981302
2026-03-24 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with scrape type 1
2026-03-24 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252F650bcb62ec364980be5a350036aae030%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/650bcb62ec364980be5a350036aae030/images/large/1.jpg not downloaded yet
2026-03-24 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1981293
2026-03-24 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1981293
2026-03-24 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1981293 to the API
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/933/019358d0ca734256b198956e14e165e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 68731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6/ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/933/019358d0ca734256b198956e14e165e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 92kW (125cv) Titanium MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 92kW (125cv) Titanium MHEV',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981293%27 HTTP/1.1" 200 None
2026-03-24 18:32:16 [ayvens.es] INFO: Saving data for 1981293: {'created_time': 1774377136.250708, 'last_price_update_time': 1774377136.250719, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981293') HTTP/1.1" 204 0
2026-03-24 18:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/467/601bbe5ee5624b35a1d8bf6e5d1514f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/653/2830b32ac5af4ba5abc7b88748112e46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:16 [ayvens.es] INFO: Found listing with ID: 1981303
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981303%27 HTTP/1.1" 200 None
2026-03-24 18:32:16 [ayvens.es] INFO: Scrape type for 1981303: 1
2026-03-24 18:32:16 [ayvens.es] INFO: Extracting data for car ID: 1981303
2026-03-24 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1981303
2026-03-24 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1341a483-ffb8-5b83-973f-8a61a5f2c672 with scrape type 1
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1341a483-ffb8-5b83-973f-8a61a5f2c672
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F006%252F081c6793a6ad48bda2c1223c1c8bc06f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/006/081c6793a6ad48bda2c1223c1c8bc06f/images/large/1.jpg not downloaded yet
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee23f290>
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aac65dc-e2e0-5a18-8681-7b469672db5a/8aac65dc-e2e0-5a18-8681-7b469672db5a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F429%252F18471555e01540ccb9abb6052b6b57ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/429/18471555e01540ccb9abb6052b6b57ff/images/large/1.jpg saved to cache
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8aac65dc-e2e0-5a18-8681-7b469672db5a
2026-03-24 18:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8aac65dc-e2e0-5a18-8681-7b469672db5a, skipping ID generation
2026-03-24 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aac65dc-e2e0-5a18-8681-7b469672db5a with scrape type 1
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8aac65dc-e2e0-5a18-8681-7b469672db5a sending to next pipeline
2026-03-24 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8aac65dc-e2e0-5a18-8681-7b469672db5a, identifier: 1981294
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee937950>
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194f51c1-0bfa-560b-8bf3-e02691a50e1d/194f51c1-0bfa-560b-8bf3-e02691a50e1d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F725%252F80b19d5fba1a47a5a09ac620af8b9c73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/725/80b19d5fba1a47a5a09ac620af8b9c73/images/large/1.jpg saved to cache
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 194f51c1-0bfa-560b-8bf3-e02691a50e1d
2026-03-24 18:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 194f51c1-0bfa-560b-8bf3-e02691a50e1d, skipping ID generation
2026-03-24 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194f51c1-0bfa-560b-8bf3-e02691a50e1d with scrape type 1
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 194f51c1-0bfa-560b-8bf3-e02691a50e1d sending to next pipeline
2026-03-24 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 194f51c1-0bfa-560b-8bf3-e02691a50e1d, identifier: 1981295
2026-03-24 18:32:16 [ayvens.es] INFO: Found listing with ID: 1981304
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981304%27 HTTP/1.1" 200 None
2026-03-24 18:32:16 [ayvens.es] INFO: Scrape type for 1981304: 1
2026-03-24 18:32:16 [ayvens.es] INFO: Extracting data for car ID: 1981304
2026-03-24 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469d742b-8035-5350-a9c6-8b1352c03a70 with identifier: 1981304
2026-03-24 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469d742b-8035-5350-a9c6-8b1352c03a70 with scrape type 1
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 469d742b-8035-5350-a9c6-8b1352c03a70
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F189c16ca585145a58611ec0a34c3efe8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/189c16ca585145a58611ec0a34c3efe8/images/large/1.jpg not downloaded yet
2026-03-24 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8aac65dc-e2e0-5a18-8681-7b469672db5a with identifier: 1981294
2026-03-24 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8aac65dc-e2e0-5a18-8681-7b469672db5a with identifier: 1981294
2026-03-24 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8aac65dc-e2e0-5a18-8681-7b469672db5a with identifier: 1981294 to the API
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/429/18471555e01540ccb9abb6052b6b57ff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Solid white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8aac65dc-e2e0-5a18-8681-7b469672db5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 48636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aac65dc-e2e0-5a18-8681-7b469672db5a/8aac65dc-e2e0-5a18-8681-7b469672db5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/429/18471555e01540ccb9abb6052b6b57ff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'transmission': 'manual',
 'trim': 'IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'vin': None,
 'year': 2023}
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981294%27 HTTP/1.1" 200 None
2026-03-24 18:32:16 [ayvens.es] INFO: Saving data for 1981294: {'created_time': 1774377136.973415, 'last_price_update_time': 1774377136.973441, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981294') HTTP/1.1" 204 0
2026-03-24 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 194f51c1-0bfa-560b-8bf3-e02691a50e1d with identifier: 1981295
2026-03-24 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 194f51c1-0bfa-560b-8bf3-e02691a50e1d with identifier: 1981295
2026-03-24 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 194f51c1-0bfa-560b-8bf3-e02691a50e1d with identifier: 1981295 to the API
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/725/80b19d5fba1a47a5a09ac620af8b9c73/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '194f51c1-0bfa-560b-8bf3-e02691a50e1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 93111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194f51c1-0bfa-560b-8bf3-e02691a50e1d/194f51c1-0bfa-560b-8bf3-e02691a50e1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/725/80b19d5fba1a47a5a09ac620af8b9c73/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981295%27 HTTP/1.1" 200 None
2026-03-24 18:32:17 [ayvens.es] INFO: Saving data for 1981295: {'created_time': 1774377137.281987, 'last_price_update_time': 1774377137.281999, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981295') HTTP/1.1" 204 0
2026-03-24 18:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/871/a214ea335a2149549920c23d522cabd3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:17 [ayvens.es] INFO: Found listing with ID: 1981305
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981305%27 HTTP/1.1" 200 None
2026-03-24 18:32:17 [ayvens.es] INFO: Scrape type for 1981305: 1
2026-03-24 18:32:17 [ayvens.es] INFO: Extracting data for car ID: 1981305
2026-03-24 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1981305
2026-03-24 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with scrape type 1
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252Fe954f4e8eae14f9bbca066867a4f7dde%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/e954f4e8eae14f9bbca066867a4f7dde/images/large/1.jpg not downloaded yet
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05ec590>
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bf36b0-b098-59ae-a631-3b2bf040d8c6/81bf36b0-b098-59ae-a631-3b2bf040d8c6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252F601bbe5ee5624b35a1d8bf6e5d1514f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/601bbe5ee5624b35a1d8bf6e5d1514f8/images/large/1.jpg saved to cache
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6
2026-03-24 18:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81bf36b0-b098-59ae-a631-3b2bf040d8c6, skipping ID generation
2026-03-24 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with scrape type 1
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6 sending to next pipeline
2026-03-24 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 81bf36b0-b098-59ae-a631-3b2bf040d8c6, identifier: 1981297
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea66390>
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e42879ed-87df-5183-a6ac-7b1711dfa501/e42879ed-87df-5183-a6ac-7b1711dfa501_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F653%252F2830b32ac5af4ba5abc7b88748112e46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/653/2830b32ac5af4ba5abc7b88748112e46/images/large/1.jpg saved to cache
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e42879ed-87df-5183-a6ac-7b1711dfa501
2026-03-24 18:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e42879ed-87df-5183-a6ac-7b1711dfa501, skipping ID generation
2026-03-24 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42879ed-87df-5183-a6ac-7b1711dfa501 with scrape type 1
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e42879ed-87df-5183-a6ac-7b1711dfa501 sending to next pipeline
2026-03-24 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e42879ed-87df-5183-a6ac-7b1711dfa501, identifier: 1981296
2026-03-24 18:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/257/1d5d8a0716c74324b6c75d70996ef6ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:17 [ayvens.es] INFO: Found listing with ID: 1981306
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981306%27 HTTP/1.1" 200 None
2026-03-24 18:32:17 [ayvens.es] INFO: Scrape type for 1981306: 1
2026-03-24 18:32:17 [ayvens.es] INFO: Extracting data for car ID: 1981306
2026-03-24 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1981306
2026-03-24 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with scrape type 1
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252F8a83d049f3164da2a3e9769c736ea79d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/8a83d049f3164da2a3e9769c736ea79d/images/large/1.jpg not downloaded yet
2026-03-24 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1981297
2026-03-24 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1981297
2026-03-24 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1981297 to the API
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/467/601bbe5ee5624b35a1d8bf6e5d1514f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Azul cavansita metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '81bf36b0-b098-59ae-a631-3b2bf040d8c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 66763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bf36b0-b098-59ae-a631-3b2bf040d8c6/81bf36b0-b098-59ae-a631-3b2bf040d8c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/601bbe5ee5624b35a1d8bf6e5d1514f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE GLC 300 de 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 de 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981297%27 HTTP/1.1" 200 None
2026-03-24 18:32:17 [ayvens.es] INFO: Saving data for 1981297: {'created_time': 1774377137.966047, 'last_price_update_time': 1774377137.966057, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981297') HTTP/1.1" 204 0
2026-03-24 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1981296
2026-03-24 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1981296
2026-03-24 18:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1981296 to the API
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/653/2830b32ac5af4ba5abc7b88748112e46/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e42879ed-87df-5183-a6ac-7b1711dfa501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 49360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e42879ed-87df-5183-a6ac-7b1711dfa501/e42879ed-87df-5183-a6ac-7b1711dfa501_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/653/2830b32ac5af4ba5abc7b88748112e46/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK BlueHDi 96 kW Auto PERFORMANCE LINE+',
 'transmission': 'manual',
 'trim': 'BlueHDi 96 kW Auto PERFORMANCE LINE+',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981296%27 HTTP/1.1" 200 None
2026-03-24 18:32:18 [ayvens.es] INFO: Saving data for 1981296: {'created_time': 1774377138.262228, 'last_price_update_time': 1774377138.262243, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981296') HTTP/1.1" 204 0
2026-03-24 18:32:18 [ayvens.es] INFO: Found listing with ID: 1981307
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981307%27 HTTP/1.1" 200 None
2026-03-24 18:32:18 [ayvens.es] INFO: Scrape type for 1981307: 1
2026-03-24 18:32:18 [ayvens.es] INFO: Extracting data for car ID: 1981307
2026-03-24 18:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1981307
2026-03-24 18:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with scrape type 1
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F5aba661dad9743da992b6b510ea958e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/5aba661dad9743da992b6b510ea958e8/images/large/1.jpg not downloaded yet
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecabd10>
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af79901b-e417-59cb-ac68-74b390473166/af79901b-e417-59cb-ac68-74b390473166_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252Fa214ea335a2149549920c23d522cabd3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/a214ea335a2149549920c23d522cabd3/images/large/1.jpg saved to cache
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af79901b-e417-59cb-ac68-74b390473166
2026-03-24 18:32:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af79901b-e417-59cb-ac68-74b390473166, skipping ID generation
2026-03-24 18:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af79901b-e417-59cb-ac68-74b390473166 with scrape type 1
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af79901b-e417-59cb-ac68-74b390473166 sending to next pipeline
2026-03-24 18:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af79901b-e417-59cb-ac68-74b390473166, identifier: 1981299
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7df210>
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f37323-ef0f-549c-b3bf-f2daf8944e53/b3f37323-ef0f-549c-b3bf-f2daf8944e53_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252F1d5d8a0716c74324b6c75d70996ef6ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/1d5d8a0716c74324b6c75d70996ef6ef/images/large/1.jpg saved to cache
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3f37323-ef0f-549c-b3bf-f2daf8944e53
2026-03-24 18:32:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3f37323-ef0f-549c-b3bf-f2daf8944e53, skipping ID generation
2026-03-24 18:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f37323-ef0f-549c-b3bf-f2daf8944e53 with scrape type 1
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3f37323-ef0f-549c-b3bf-f2daf8944e53 sending to next pipeline
2026-03-24 18:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b3f37323-ef0f-549c-b3bf-f2daf8944e53, identifier: 1981298
2026-03-24 18:32:18 [ayvens.es] INFO: Found listing with ID: 1981308
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981308%27 HTTP/1.1" 200 None
2026-03-24 18:32:18 [ayvens.es] INFO: Scrape type for 1981308: 1
2026-03-24 18:32:18 [ayvens.es] INFO: Extracting data for car ID: 1981308
2026-03-24 18:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1981308
2026-03-24 18:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec5cad9-010b-53ea-88ef-ed98e091075c with scrape type 1
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ec5cad9-010b-53ea-88ef-ed98e091075c
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252F489a8b7f333d41a9be54e8b21df4cdaa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/489a8b7f333d41a9be54e8b21df4cdaa/images/large/1.jpg not downloaded yet
2026-03-24 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1981299
2026-03-24 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1981299
2026-03-24 18:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1981299 to the API
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/871/a214ea335a2149549920c23d522cabd3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Gris selenita metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'af79901b-e417-59cb-ac68-74b390473166',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 161554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af79901b-e417-59cb-ac68-74b390473166/af79901b-e417-59cb-ac68-74b390473166_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/871/a214ea335a2149549920c23d522cabd3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 200 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 200 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981299%27 HTTP/1.1" 200 None
2026-03-24 18:32:18 [ayvens.es] INFO: Saving data for 1981299: {'created_time': 1774377138.963035, 'last_price_update_time': 1774377138.963047, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981299') HTTP/1.1" 204 0
2026-03-24 18:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b3f37323-ef0f-549c-b3bf-f2daf8944e53 with identifier: 1981298
2026-03-24 18:32:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b3f37323-ef0f-549c-b3bf-f2daf8944e53 with identifier: 1981298
2026-03-24 18:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b3f37323-ef0f-549c-b3bf-f2daf8944e53 with identifier: 1981298 to the API
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/257/1d5d8a0716c74324b6c75d70996ef6ef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Mineralwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3f37323-ef0f-549c-b3bf-f2daf8944e53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f37323-ef0f-549c-b3bf-f2daf8944e53/b3f37323-ef0f-549c-b3bf-f2daf8944e53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/257/1d5d8a0716c74324b6c75d70996ef6ef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive16d',
 'transmission': 'manual',
 'trim': 'sDrive16d',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981298%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [ayvens.es] INFO: Saving data for 1981298: {'created_time': 1774377139.387892, 'last_price_update_time': 1774377139.387904, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981298') HTTP/1.1" 204 0
2026-03-24 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/482/25308ba53ca34313823f21cb75682e8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/122/a373b4d5a5194c97acbfbc065f3d4f19/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/048/650bcb62ec364980be5a350036aae030/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/006/081c6793a6ad48bda2c1223c1c8bc06f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:19 [ayvens.es] INFO: Found listing with ID: 1981309
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981309%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [ayvens.es] INFO: Scrape type for 1981309: 1
2026-03-24 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1981309
2026-03-24 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c97d04fc-b855-5a28-8242-16da899d5164 with identifier: 1981309
2026-03-24 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97d04fc-b855-5a28-8242-16da899d5164 with scrape type 1
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c97d04fc-b855-5a28-8242-16da899d5164
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F69a709190e6341308e44243b82be5e3b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/69a709190e6341308e44243b82be5e3b/images/large/1.jpg not downloaded yet
2026-03-24 18:32:19 [ayvens.es] INFO: Found listing with ID: 1981310
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981310%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [ayvens.es] INFO: Scrape type for 1981310: 1
2026-03-24 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1981310
2026-03-24 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3748a7a-d127-5dc0-ab32-c4a4f64ed069 with identifier: 1981310
2026-03-24 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3748a7a-d127-5dc0-ab32-c4a4f64ed069 with scrape type 1
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3748a7a-d127-5dc0-ab32-c4a4f64ed069
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F778f077e6afd4fab8817b397c39773e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/778f077e6afd4fab8817b397c39773e5/images/large/1.jpg not downloaded yet
2026-03-24 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/478/189c16ca585145a58611ec0a34c3efe8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:19 [ayvens.es] INFO: Found listing with ID: 1981311
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981311%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [ayvens.es] INFO: Scrape type for 1981311: 1
2026-03-24 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1981311
2026-03-24 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1981311
2026-03-24 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad92e02-c68f-5c66-a2a6-99a773672f51 with scrape type 1
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ad92e02-c68f-5c66-a2a6-99a773672f51
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252F91673ef3d7db4ade8298ffd26efe0960%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/91673ef3d7db4ade8298ffd26efe0960/images/large/1.jpg not downloaded yet
2026-03-24 18:32:19 [ayvens.es] INFO: Found listing with ID: 1981312
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981312%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [ayvens.es] INFO: Scrape type for 1981312: 1
2026-03-24 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1981312
2026-03-24 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1981312
2026-03-24 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bd9482-6f5f-55ae-960f-b24ae95022e3 with scrape type 1
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36bd9482-6f5f-55ae-960f-b24ae95022e3
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252Fb3a1a262686c46d7895468d174a9b7e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/b3a1a262686c46d7895468d174a9b7e5/images/large/1.jpg not downloaded yet
2026-03-24 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/100/e954f4e8eae14f9bbca066867a4f7dde/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed498d0>
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fbe28ff-d0d1-56e8-9199-ac0cd7375b39/7fbe28ff-d0d1-56e8-9199-ac0cd7375b39_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F25308ba53ca34313823f21cb75682e8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/25308ba53ca34313823f21cb75682e8b/images/large/1.jpg saved to cache
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39
2026-03-24 18:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39, skipping ID generation
2026-03-24 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with scrape type 1
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 sending to next pipeline
2026-03-24 18:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39, identifier: 1981301
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6cd690>
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89ec6bbc-1aa1-5380-b25a-338417e9c526/89ec6bbc-1aa1-5380-b25a-338417e9c526_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Fa373b4d5a5194c97acbfbc065f3d4f19%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/a373b4d5a5194c97acbfbc065f3d4f19/images/large/1.jpg saved to cache
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89ec6bbc-1aa1-5380-b25a-338417e9c526
2026-03-24 18:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89ec6bbc-1aa1-5380-b25a-338417e9c526, skipping ID generation
2026-03-24 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ec6bbc-1aa1-5380-b25a-338417e9c526 with scrape type 1
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89ec6bbc-1aa1-5380-b25a-338417e9c526 sending to next pipeline
2026-03-24 18:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89ec6bbc-1aa1-5380-b25a-338417e9c526, identifier: 1981300
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1ff990>
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6/e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252F650bcb62ec364980be5a350036aae030%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/650bcb62ec364980be5a350036aae030/images/large/1.jpg saved to cache
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6
2026-03-24 18:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6, skipping ID generation
2026-03-24 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with scrape type 1
2026-03-24 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 sending to next pipeline
2026-03-24 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6, identifier: 1981302
2026-03-24 18:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee25b9d0>
2026-03-24 18:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1341a483-ffb8-5b83-973f-8a61a5f2c672/1341a483-ffb8-5b83-973f-8a61a5f2c672_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F006%252F081c6793a6ad48bda2c1223c1c8bc06f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/006/081c6793a6ad48bda2c1223c1c8bc06f/images/large/1.jpg saved to cache
2026-03-24 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1341a483-ffb8-5b83-973f-8a61a5f2c672
2026-03-24 18:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1341a483-ffb8-5b83-973f-8a61a5f2c672, skipping ID generation
2026-03-24 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1341a483-ffb8-5b83-973f-8a61a5f2c672 with scrape type 1
2026-03-24 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1341a483-ffb8-5b83-973f-8a61a5f2c672 sending to next pipeline
2026-03-24 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1341a483-ffb8-5b83-973f-8a61a5f2c672, identifier: 1981303
2026-03-24 18:32:20 [ayvens.es] INFO: Found listing with ID: 1981313
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981313%27 HTTP/1.1" 200 None
2026-03-24 18:32:20 [ayvens.es] INFO: Scrape type for 1981313: 1
2026-03-24 18:32:20 [ayvens.es] INFO: Extracting data for car ID: 1981313
2026-03-24 18:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1981313
2026-03-24 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad5195a-f59c-5f8a-9325-c8421d84377a with scrape type 1
2026-03-24 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cad5195a-f59c-5f8a-9325-c8421d84377a
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252Fc20094f79b89444a8bac7ea828c0cc22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/c20094f79b89444a8bac7ea828c0cc22/images/large/1.jpg not downloaded yet
2026-03-24 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1981301
2026-03-24 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1981301
2026-03-24 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1981301 to the API
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/482/25308ba53ca34313823f21cb75682e8b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7fbe28ff-d0d1-56e8-9199-ac0cd7375b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 178555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbe28ff-d0d1-56e8-9199-ac0cd7375b39/7fbe28ff-d0d1-56e8-9199-ac0cd7375b39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/482/25308ba53ca34313823f21cb75682e8b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981301%27 HTTP/1.1" 200 None
2026-03-24 18:32:20 [ayvens.es] INFO: Saving data for 1981301: {'created_time': 1774377140.647277, 'last_price_update_time': 1774377140.647288, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981301') HTTP/1.1" 204 0
2026-03-24 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1981300
2026-03-24 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1981300
2026-03-24 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1981300 to the API
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/122/a373b4d5a5194c97acbfbc065f3d4f19/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Plata iridio metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89ec6bbc-1aa1-5380-b25a-338417e9c526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 109509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ec6bbc-1aa1-5380-b25a-338417e9c526/89ec6bbc-1aa1-5380-b25a-338417e9c526_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/122/a373b4d5a5194c97acbfbc065f3d4f19/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 220 D 4MATIC',
 'transmission': 'manual',
 'trim': 'GLA 220 D 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981300%27 HTTP/1.1" 200 None
2026-03-24 18:32:20 [ayvens.es] INFO: Saving data for 1981300: {'created_time': 1774377140.944133, 'last_price_update_time': 1774377140.944144, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981300') HTTP/1.1" 204 0
2026-03-24 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1981302
2026-03-24 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1981302
2026-03-24 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1981302 to the API
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/048/650bcb62ec364980be5a350036aae030/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 73720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6/e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/048/650bcb62ec364980be5a350036aae030/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981302%27 HTTP/1.1" 200 None
2026-03-24 18:32:21 [ayvens.es] INFO: Saving data for 1981302: {'created_time': 1774377141.234019, 'last_price_update_time': 1774377141.234029, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981302') HTTP/1.1" 204 0
2026-03-24 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1981303
2026-03-24 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1981303
2026-03-24 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1981303 to the API
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/006/081c6793a6ad48bda2c1223c1c8bc06f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1341a483-ffb8-5b83-973f-8a61a5f2c672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 133113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1341a483-ffb8-5b83-973f-8a61a5f2c672/1341a483-ffb8-5b83-973f-8a61a5f2c672_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/006/081c6793a6ad48bda2c1223c1c8bc06f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 CDTi 120 Aniversario',
 'transmission': 'manual',
 'trim': '1.5 CDTi 120 Aniversario',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981303%27 HTTP/1.1" 200 None
2026-03-24 18:32:21 [ayvens.es] INFO: Saving data for 1981303: {'created_time': 1774377141.534724, 'last_price_update_time': 1774377141.534736, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981303') HTTP/1.1" 204 0
2026-03-24 18:32:21 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea1d210>
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469d742b-8035-5350-a9c6-8b1352c03a70/469d742b-8035-5350-a9c6-8b1352c03a70_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F189c16ca585145a58611ec0a34c3efe8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/189c16ca585145a58611ec0a34c3efe8/images/large/1.jpg saved to cache
2026-03-24 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 469d742b-8035-5350-a9c6-8b1352c03a70
2026-03-24 18:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 469d742b-8035-5350-a9c6-8b1352c03a70, skipping ID generation
2026-03-24 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469d742b-8035-5350-a9c6-8b1352c03a70 with scrape type 1
2026-03-24 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 469d742b-8035-5350-a9c6-8b1352c03a70 sending to next pipeline
2026-03-24 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 469d742b-8035-5350-a9c6-8b1352c03a70, identifier: 1981304
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee3a010>
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878/62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252Fe954f4e8eae14f9bbca066867a4f7dde%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/e954f4e8eae14f9bbca066867a4f7dde/images/large/1.jpg saved to cache
2026-03-24 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878
2026-03-24 18:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878, skipping ID generation
2026-03-24 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with scrape type 1
2026-03-24 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 sending to next pipeline
2026-03-24 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878, identifier: 1981305
2026-03-24 18:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/758/8a83d049f3164da2a3e9769c736ea79d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 469d742b-8035-5350-a9c6-8b1352c03a70 with identifier: 1981304
2026-03-24 18:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 469d742b-8035-5350-a9c6-8b1352c03a70 with identifier: 1981304
2026-03-24 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 469d742b-8035-5350-a9c6-8b1352c03a70 with identifier: 1981304 to the API
2026-03-24 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/478/189c16ca585145a58611ec0a34c3efe8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '469d742b-8035-5350-a9c6-8b1352c03a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'X-TRAIL',
 'odometer': 121191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469d742b-8035-5350-a9c6-8b1352c03a70/469d742b-8035-5350-a9c6-8b1352c03a70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/478/189c16ca585145a58611ec0a34c3efe8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN X-TRAIL 5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'transmission': 'manual',
 'trim': '5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981304%27 HTTP/1.1" 200 None
2026-03-24 18:32:22 [ayvens.es] INFO: Saving data for 1981304: {'created_time': 1774377142.150386, 'last_price_update_time': 1774377142.150396, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981304') HTTP/1.1" 204 0
2026-03-24 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1981305
2026-03-24 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1981305
2026-03-24 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1981305 to the API
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/100/e954f4e8eae14f9bbca066867a4f7dde/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata solar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 60736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878/62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/100/e954f4e8eae14f9bbca066867a4f7dde/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981305%27 HTTP/1.1" 200 None
2026-03-24 18:32:22 [ayvens.es] INFO: Saving data for 1981305: {'created_time': 1774377142.455816, 'last_price_update_time': 1774377142.455826, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981305') HTTP/1.1" 204 0
2026-03-24 18:32:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 18:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/945/5aba661dad9743da992b6b510ea958e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/426/69a709190e6341308e44243b82be5e3b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/548/489a8b7f333d41a9be54e8b21df4cdaa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/654/778f077e6afd4fab8817b397c39773e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee83fc90>
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503/f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252F8a83d049f3164da2a3e9769c736ea79d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/8a83d049f3164da2a3e9769c736ea79d/images/large/1.jpg saved to cache
2026-03-24 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503
2026-03-24 18:32:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503, skipping ID generation
2026-03-24 18:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with scrape type 1
2026-03-24 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 sending to next pipeline
2026-03-24 18:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503, identifier: 1981306
2026-03-24 18:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/371/91673ef3d7db4ade8298ffd26efe0960/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1981306
2026-03-24 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1981306
2026-03-24 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1981306 to the API
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/758/8a83d049f3164da2a3e9769c736ea79d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 39041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503/f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/758/8a83d049f3164da2a3e9769c736ea79d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA (O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'transmission': 'manual',
 'trim': '(O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981306%27 HTTP/1.1" 200 None
2026-03-24 18:32:22 [ayvens.es] INFO: Saving data for 1981306: {'created_time': 1774377142.918087, 'last_price_update_time': 1774377142.918097, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981306') HTTP/1.1" 204 0
2026-03-24 18:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/885/b3a1a262686c46d7895468d174a9b7e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee244bd0>
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca/3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F5aba661dad9743da992b6b510ea958e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/5aba661dad9743da992b6b510ea958e8/images/large/1.jpg saved to cache
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca
2026-03-24 18:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca, skipping ID generation
2026-03-24 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with scrape type 1
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca sending to next pipeline
2026-03-24 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca, identifier: 1981307
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef5d410>
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c97d04fc-b855-5a28-8242-16da899d5164/c97d04fc-b855-5a28-8242-16da899d5164_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F69a709190e6341308e44243b82be5e3b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/69a709190e6341308e44243b82be5e3b/images/large/1.jpg saved to cache
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c97d04fc-b855-5a28-8242-16da899d5164
2026-03-24 18:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c97d04fc-b855-5a28-8242-16da899d5164, skipping ID generation
2026-03-24 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97d04fc-b855-5a28-8242-16da899d5164 with scrape type 1
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c97d04fc-b855-5a28-8242-16da899d5164 sending to next pipeline
2026-03-24 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c97d04fc-b855-5a28-8242-16da899d5164, identifier: 1981309
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f12c29d0>
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec5cad9-010b-53ea-88ef-ed98e091075c/2ec5cad9-010b-53ea-88ef-ed98e091075c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252F489a8b7f333d41a9be54e8b21df4cdaa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/489a8b7f333d41a9be54e8b21df4cdaa/images/large/1.jpg saved to cache
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ec5cad9-010b-53ea-88ef-ed98e091075c
2026-03-24 18:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ec5cad9-010b-53ea-88ef-ed98e091075c, skipping ID generation
2026-03-24 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec5cad9-010b-53ea-88ef-ed98e091075c with scrape type 1
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ec5cad9-010b-53ea-88ef-ed98e091075c sending to next pipeline
2026-03-24 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2ec5cad9-010b-53ea-88ef-ed98e091075c, identifier: 1981308
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7d7390>
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748a7a-d127-5dc0-ab32-c4a4f64ed069/d3748a7a-d127-5dc0-ab32-c4a4f64ed069_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F778f077e6afd4fab8817b397c39773e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/778f077e6afd4fab8817b397c39773e5/images/large/1.jpg saved to cache
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3748a7a-d127-5dc0-ab32-c4a4f64ed069
2026-03-24 18:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3748a7a-d127-5dc0-ab32-c4a4f64ed069, skipping ID generation
2026-03-24 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3748a7a-d127-5dc0-ab32-c4a4f64ed069 with scrape type 1
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3748a7a-d127-5dc0-ab32-c4a4f64ed069 sending to next pipeline
2026-03-24 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3748a7a-d127-5dc0-ab32-c4a4f64ed069, identifier: 1981310
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee905350>
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ad92e02-c68f-5c66-a2a6-99a773672f51/8ad92e02-c68f-5c66-a2a6-99a773672f51_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252F91673ef3d7db4ade8298ffd26efe0960%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/91673ef3d7db4ade8298ffd26efe0960/images/large/1.jpg saved to cache
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ad92e02-c68f-5c66-a2a6-99a773672f51
2026-03-24 18:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ad92e02-c68f-5c66-a2a6-99a773672f51, skipping ID generation
2026-03-24 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad92e02-c68f-5c66-a2a6-99a773672f51 with scrape type 1
2026-03-24 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ad92e02-c68f-5c66-a2a6-99a773672f51 sending to next pipeline
2026-03-24 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ad92e02-c68f-5c66-a2a6-99a773672f51, identifier: 1981311
2026-03-24 18:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/601/c20094f79b89444a8bac7ea828c0cc22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1981307
2026-03-24 18:32:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1981307
2026-03-24 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1981307 to the API
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/945/5aba661dad9743da992b6b510ea958e8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'color': 'Santorini black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 89884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca/3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/5aba661dad9743da992b6b510ea958e8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER SPORT 3.0D I6 220kW AWD HSE Dynamic Stealth',
 'transmission': 'manual',
 'trim': '3.0D I6 220kW AWD HSE Dynamic Stealth',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981307%27 HTTP/1.1" 200 None
2026-03-24 18:32:24 [ayvens.es] INFO: Saving data for 1981307: {'created_time': 1774377144.198392, 'last_price_update_time': 1774377144.198402, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981307') HTTP/1.1" 204 0
2026-03-24 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c97d04fc-b855-5a28-8242-16da899d5164 with identifier: 1981309
2026-03-24 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c97d04fc-b855-5a28-8242-16da899d5164 with identifier: 1981309
2026-03-24 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c97d04fc-b855-5a28-8242-16da899d5164 with identifier: 1981309 to the API
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/426/69a709190e6341308e44243b82be5e3b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Gris daytona',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c97d04fc-b855-5a28-8242-16da899d5164',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 82450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c97d04fc-b855-5a28-8242-16da899d5164/c97d04fc-b855-5a28-8242-16da899d5164_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/426/69a709190e6341308e44243b82be5e3b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A5 B.Line 35 TFSI S tronic Sportback',
 'transmission': 'manual',
 'trim': 'B.Line 35 TFSI S tronic Sportback',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981309%27 HTTP/1.1" 200 None
2026-03-24 18:32:24 [ayvens.es] INFO: Saving data for 1981309: {'created_time': 1774377144.49548, 'last_price_update_time': 1774377144.495491, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981309') HTTP/1.1" 204 0
2026-03-24 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1981308
2026-03-24 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1981308
2026-03-24 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1981308 to the API
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/548/489a8b7f333d41a9be54e8b21df4cdaa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2ec5cad9-010b-53ea-88ef-ed98e091075c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 148770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec5cad9-010b-53ea-88ef-ed98e091075c/2ec5cad9-010b-53ea-88ef-ed98e091075c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/548/489a8b7f333d41a9be54e8b21df4cdaa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Lounge',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Lounge',
 'vin': None,
 'year': 2017}
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981308%27 HTTP/1.1" 200 None
2026-03-24 18:32:24 [ayvens.es] INFO: Saving data for 1981308: {'created_time': 1774377144.770194, 'last_price_update_time': 1774377144.770203, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981308') HTTP/1.1" 204 0
2026-03-24 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3748a7a-d127-5dc0-ab32-c4a4f64ed069 with identifier: 1981310
2026-03-24 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3748a7a-d127-5dc0-ab32-c4a4f64ed069 with identifier: 1981310
2026-03-24 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3748a7a-d127-5dc0-ab32-c4a4f64ed069 with identifier: 1981310 to the API
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/654/778f077e6afd4fab8817b397c39773e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata solar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd3748a7a-d127-5dc0-ab32-c4a4f64ed069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 99741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748a7a-d127-5dc0-ab32-c4a4f64ed069/d3748a7a-d127-5dc0-ab32-c4a4f64ed069_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/654/778f077e6afd4fab8817b397c39773e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981310%27 HTTP/1.1" 200 None
2026-03-24 18:32:25 [ayvens.es] INFO: Saving data for 1981310: {'created_time': 1774377145.063239, 'last_price_update_time': 1774377145.06325, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981310') HTTP/1.1" 204 0
2026-03-24 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1981311
2026-03-24 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1981311
2026-03-24 18:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1981311 to the API
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/371/91673ef3d7db4ade8298ffd26efe0960/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Gris acero',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ad92e02-c68f-5c66-a2a6-99a773672f51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA',
 'odometer': 87860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad92e02-c68f-5c66-a2a6-99a773672f51/8ad92e02-c68f-5c66-a2a6-99a773672f51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/371/91673ef3d7db4ade8298ffd26efe0960/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA ST GS Line Plus 2.0D DVH 130kW AT8',
 'transmission': 'manual',
 'trim': 'ST GS Line Plus 2.0D DVH 130kW AT8',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981311%27 HTTP/1.1" 200 None
2026-03-24 18:32:25 [ayvens.es] INFO: Saving data for 1981311: {'created_time': 1774377145.526521, 'last_price_update_time': 1774377145.52653, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981311') HTTP/1.1" 204 0
2026-03-24 18:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9b2090>
2026-03-24 18:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bd9482-6f5f-55ae-960f-b24ae95022e3/36bd9482-6f5f-55ae-960f-b24ae95022e3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252Fb3a1a262686c46d7895468d174a9b7e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/b3a1a262686c46d7895468d174a9b7e5/images/large/1.jpg saved to cache
2026-03-24 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36bd9482-6f5f-55ae-960f-b24ae95022e3
2026-03-24 18:32:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36bd9482-6f5f-55ae-960f-b24ae95022e3, skipping ID generation
2026-03-24 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bd9482-6f5f-55ae-960f-b24ae95022e3 with scrape type 1
2026-03-24 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36bd9482-6f5f-55ae-960f-b24ae95022e3 sending to next pipeline
2026-03-24 18:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36bd9482-6f5f-55ae-960f-b24ae95022e3, identifier: 1981312
2026-03-24 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1981312
2026-03-24 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1981312
2026-03-24 18:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1981312 to the API
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/885/b3a1a262686c46d7895468d174a9b7e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '36bd9482-6f5f-55ae-960f-b24ae95022e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 75513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bd9482-6f5f-55ae-960f-b24ae95022e3/36bd9482-6f5f-55ae-960f-b24ae95022e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/885/b3a1a262686c46d7895468d174a9b7e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981312%27 HTTP/1.1" 200 None
2026-03-24 18:32:25 [ayvens.es] INFO: Saving data for 1981312: {'created_time': 1774377145.975313, 'last_price_update_time': 1774377145.975323, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981312') HTTP/1.1" 204 0
2026-03-24 18:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7e8a10>
2026-03-24 18:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cad5195a-f59c-5f8a-9325-c8421d84377a/cad5195a-f59c-5f8a-9325-c8421d84377a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252Fc20094f79b89444a8bac7ea828c0cc22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/c20094f79b89444a8bac7ea828c0cc22/images/large/1.jpg saved to cache
2026-03-24 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cad5195a-f59c-5f8a-9325-c8421d84377a
2026-03-24 18:32:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cad5195a-f59c-5f8a-9325-c8421d84377a, skipping ID generation
2026-03-24 18:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad5195a-f59c-5f8a-9325-c8421d84377a with scrape type 1
2026-03-24 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cad5195a-f59c-5f8a-9325-c8421d84377a sending to next pipeline
2026-03-24 18:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cad5195a-f59c-5f8a-9325-c8421d84377a, identifier: 1981313
2026-03-24 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1981313
2026-03-24 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1981313
2026-03-24 18:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1981313 to the API
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/601/c20094f79b89444a8bac7ea828c0cc22/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Thypoon silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'cad5195a-f59c-5f8a-9325-c8421d84377a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 157615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad5195a-f59c-5f8a-9325-c8421d84377a/cad5195a-f59c-5f8a-9325-c8421d84377a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/601/c20094f79b89444a8bac7ea828c0cc22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Tecno DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Tecno DCT',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981313%27 HTTP/1.1" 200 None
2026-03-24 18:32:26 [ayvens.es] INFO: Saving data for 1981313: {'created_time': 1774377146.498256, 'last_price_update_time': 1774377146.498266, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981313') HTTP/1.1" 204 0
2026-03-24 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981314
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981314%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981314: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981314
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1981314
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd209322-3ad3-512e-8914-fc2f7d30c22b with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd209322-3ad3-512e-8914-fc2f7d30c22b
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252Fc0e66fc726d44aff8df854032c16ebfc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/c0e66fc726d44aff8df854032c16ebfc/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981315
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981315%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981315: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981315
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bd7bba-f820-5579-8c2c-4456c6078962 with identifier: 1981315
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bd7bba-f820-5579-8c2c-4456c6078962 with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 00bd7bba-f820-5579-8c2c-4456c6078962
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F4f1c4de1857d483fa61c580b322a7791%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/4f1c4de1857d483fa61c580b322a7791/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981316
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981316%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981316: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981316
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d with identifier: 1981316
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F472%252F9f238eab29d748b8a5b50bb0568420ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/472/9f238eab29d748b8a5b50bb0568420ba/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981317
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981317%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981317: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981317
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1981317
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8601ad7-3a34-53e6-943f-3f518fcfaa77 with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8601ad7-3a34-53e6-943f-3f518fcfaa77
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252Ff8f3139323e94778a93355af04fac0d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/f8f3139323e94778a93355af04fac0d6/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981318
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981318%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981318: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981318
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1981318
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19811d5a-f341-58bf-a625-1f35d87f7ba8 with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 19811d5a-f341-58bf-a625-1f35d87f7ba8
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F99851fecf2fc41df8e4428090cd12e78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/99851fecf2fc41df8e4428090cd12e78/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981319
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981319%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981319: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981319
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1981319
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a16029-39db-55f4-b512-bef98bbc8c00 with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5a16029-39db-55f4-b512-bef98bbc8c00
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252Fdd5e7a2c58cc485f8b6c7cff364ababa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/dd5e7a2c58cc485f8b6c7cff364ababa/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981320
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981320%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981320: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981320
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1981320
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Fb40beb6a0d1343fc92154cf4bf6353c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/b40beb6a0d1343fc92154cf4bf6353c2/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981321
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981321%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981321: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981321
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed6c030-aa5f-5747-915a-a19e020fbde4 with identifier: 1981321
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed6c030-aa5f-5747-915a-a19e020fbde4 with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ed6c030-aa5f-5747-915a-a19e020fbde4
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F525%252Fcc12bf13f0fa49fd9b59c2f731df2fb4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/525/cc12bf13f0fa49fd9b59c2f731df2fb4/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/968/4f1c4de1857d483fa61c580b322a7791/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/557/c0e66fc726d44aff8df854032c16ebfc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981322
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981322%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981322: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981322
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1981322
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772ccc08-4770-55a8-9a32-53a52f27b854 with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 772ccc08-4770-55a8-9a32-53a52f27b854
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F951%252F52c8824b3c02471991e28096fae468ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/951/52c8824b3c02471991e28096fae468ec/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981323
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981323%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [ayvens.es] INFO: Scrape type for 1981323: 1
2026-03-24 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1981323
2026-03-24 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1981323
2026-03-24 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c2915e-35ca-507a-8eb0-b8809abfae4e with scrape type 1
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99c2915e-35ca-507a-8eb0-b8809abfae4e
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F4be050196217493abd057324a4fafcf0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/4be050196217493abd057324a4fafcf0/images/large/1.jpg not downloaded yet
2026-03-24 18:32:27 [ayvens.es] INFO: Found listing with ID: 1981324
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981324%27 HTTP/1.1" 200 None
2026-03-24 18:32:28 [ayvens.es] INFO: Scrape type for 1981324: 1
2026-03-24 18:32:28 [ayvens.es] INFO: Extracting data for car ID: 1981324
2026-03-24 18:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1981324
2026-03-24 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429b4528-74ec-5701-97b6-b3d9ac42a82d with scrape type 1
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 429b4528-74ec-5701-97b6-b3d9ac42a82d
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F0ceb9a2d4ae9418bb7856affe73abc43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/0ceb9a2d4ae9418bb7856affe73abc43/images/large/1.jpg not downloaded yet
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee922a50>
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bd7bba-f820-5579-8c2c-4456c6078962/00bd7bba-f820-5579-8c2c-4456c6078962_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F4f1c4de1857d483fa61c580b322a7791%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/4f1c4de1857d483fa61c580b322a7791/images/large/1.jpg saved to cache
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00bd7bba-f820-5579-8c2c-4456c6078962
2026-03-24 18:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00bd7bba-f820-5579-8c2c-4456c6078962, skipping ID generation
2026-03-24 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bd7bba-f820-5579-8c2c-4456c6078962 with scrape type 1
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00bd7bba-f820-5579-8c2c-4456c6078962 sending to next pipeline
2026-03-24 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 00bd7bba-f820-5579-8c2c-4456c6078962, identifier: 1981315
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6e3c50>
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd209322-3ad3-512e-8914-fc2f7d30c22b/fd209322-3ad3-512e-8914-fc2f7d30c22b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252Fc0e66fc726d44aff8df854032c16ebfc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/c0e66fc726d44aff8df854032c16ebfc/images/large/1.jpg saved to cache
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd209322-3ad3-512e-8914-fc2f7d30c22b
2026-03-24 18:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd209322-3ad3-512e-8914-fc2f7d30c22b, skipping ID generation
2026-03-24 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd209322-3ad3-512e-8914-fc2f7d30c22b with scrape type 1
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd209322-3ad3-512e-8914-fc2f7d30c22b sending to next pipeline
2026-03-24 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd209322-3ad3-512e-8914-fc2f7d30c22b, identifier: 1981314
2026-03-24 18:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/472/9f238eab29d748b8a5b50bb0568420ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:28 [ayvens.es] INFO: Found listing with ID: 1981325
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981325%27 HTTP/1.1" 200 None
2026-03-24 18:32:28 [ayvens.es] INFO: Scrape type for 1981325: 1
2026-03-24 18:32:28 [ayvens.es] INFO: Extracting data for car ID: 1981325
2026-03-24 18:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b with identifier: 1981325
2026-03-24 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b with scrape type 1
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F3c1f3ed651ff4065a399abbf99bf5110%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/3c1f3ed651ff4065a399abbf99bf5110/images/large/1.jpg not downloaded yet
2026-03-24 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 00bd7bba-f820-5579-8c2c-4456c6078962 with identifier: 1981315
2026-03-24 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 00bd7bba-f820-5579-8c2c-4456c6078962 with identifier: 1981315
2026-03-24 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 00bd7bba-f820-5579-8c2c-4456c6078962 with identifier: 1981315 to the API
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/968/4f1c4de1857d483fa61c580b322a7791/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '00bd7bba-f820-5579-8c2c-4456c6078962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 97809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bd7bba-f820-5579-8c2c-4456c6078962/00bd7bba-f820-5579-8c2c-4456c6078962_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/968/4f1c4de1857d483fa61c580b322a7791/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981315%27 HTTP/1.1" 200 None
2026-03-24 18:32:28 [ayvens.es] INFO: Saving data for 1981315: {'created_time': 1774377148.765497, 'last_price_update_time': 1774377148.765507, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981315') HTTP/1.1" 204 0
2026-03-24 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1981314
2026-03-24 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1981314
2026-03-24 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1981314 to the API
2026-03-24 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/557/c0e66fc726d44aff8df854032c16ebfc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fd209322-3ad3-512e-8914-fc2f7d30c22b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 114930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd209322-3ad3-512e-8914-fc2f7d30c22b/fd209322-3ad3-512e-8914-fc2f7d30c22b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/557/c0e66fc726d44aff8df854032c16ebfc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Lounge',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Lounge',
 'vin': None,
 'year': 2017}
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981314%27 HTTP/1.1" 200 None
2026-03-24 18:32:29 [ayvens.es] INFO: Saving data for 1981314: {'created_time': 1774377149.328086, 'last_price_update_time': 1774377149.328099, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981314') HTTP/1.1" 204 0
2026-03-24 18:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/107/f8f3139323e94778a93355af04fac0d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:29 [ayvens.es] INFO: Found listing with ID: 1981326
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981326%27 HTTP/1.1" 200 None
2026-03-24 18:32:29 [ayvens.es] INFO: Scrape type for 1981326: 1
2026-03-24 18:32:29 [ayvens.es] INFO: Extracting data for car ID: 1981326
2026-03-24 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1981326
2026-03-24 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c with scrape type 1
2026-03-24 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Fa4ffce93807a476697c439a0ae22f8a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/a4ffce93807a476697c439a0ae22f8a3/images/large/1.jpg not downloaded yet
2026-03-24 18:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/525/cc12bf13f0fa49fd9b59c2f731df2fb4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee22c5d0>
2026-03-24 18:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d/f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F472%252F9f238eab29d748b8a5b50bb0568420ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/472/9f238eab29d748b8a5b50bb0568420ba/images/large/1.jpg saved to cache
2026-03-24 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d
2026-03-24 18:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d, skipping ID generation
2026-03-24 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d with scrape type 1
2026-03-24 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d sending to next pipeline
2026-03-24 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d, identifier: 1981316
2026-03-24 18:32:29 [ayvens.es] INFO: Found listing with ID: 1981327
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981327%27 HTTP/1.1" 200 None
2026-03-24 18:32:29 [ayvens.es] INFO: Scrape type for 1981327: 1
2026-03-24 18:32:29 [ayvens.es] INFO: Extracting data for car ID: 1981327
2026-03-24 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be3df49-2678-5a39-a904-3d9aaf57e49d with identifier: 1981327
2026-03-24 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be3df49-2678-5a39-a904-3d9aaf57e49d with scrape type 1
2026-03-24 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6be3df49-2678-5a39-a904-3d9aaf57e49d
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F568%252F51b06150bb8d469db682217546cab688%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/568/51b06150bb8d469db682217546cab688/images/large/1.jpg not downloaded yet
2026-03-24 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d with identifier: 1981316
2026-03-24 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d with identifier: 1981316
2026-03-24 18:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d with identifier: 1981316 to the API
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/472/9f238eab29d748b8a5b50bb0568420ba/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Negro mitos',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 73042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d/f79d38ff-eb33-55e3-b2a7-9eafa8d1b52d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/472/9f238eab29d748b8a5b50bb0568420ba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Advanced 50 TFSI e quattro-ultra',
 'transmission': 'manual',
 'trim': 'Advanced 50 TFSI e quattro-ultra',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981316%27 HTTP/1.1" 200 None
2026-03-24 18:32:30 [ayvens.es] INFO: Saving data for 1981316: {'created_time': 1774377150.035392, 'last_price_update_time': 1774377150.035402, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981316') HTTP/1.1" 204 0
2026-03-24 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/561/dd5e7a2c58cc485f8b6c7cff364ababa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/99851fecf2fc41df8e4428090cd12e78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/951/52c8824b3c02471991e28096fae468ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:30 [ayvens.es] INFO: Found listing with ID: 1981328
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981328%27 HTTP/1.1" 200 None
2026-03-24 18:32:30 [ayvens.es] INFO: Scrape type for 1981328: 1
2026-03-24 18:32:30 [ayvens.es] INFO: Extracting data for car ID: 1981328
2026-03-24 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d9bfa44-9ad1-52db-8969-ef1904c2d128 with identifier: 1981328
2026-03-24 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d9bfa44-9ad1-52db-8969-ef1904c2d128 with scrape type 1
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2d9bfa44-9ad1-52db-8969-ef1904c2d128
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F608%252F3da18740da9e488597cbcaf85decc353%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/608/3da18740da9e488597cbcaf85decc353/images/large/1.jpg not downloaded yet
2026-03-24 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/4be050196217493abd057324a4fafcf0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6b49d0>
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8601ad7-3a34-53e6-943f-3f518fcfaa77/f8601ad7-3a34-53e6-943f-3f518fcfaa77_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252Ff8f3139323e94778a93355af04fac0d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/f8f3139323e94778a93355af04fac0d6/images/large/1.jpg saved to cache
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8601ad7-3a34-53e6-943f-3f518fcfaa77
2026-03-24 18:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8601ad7-3a34-53e6-943f-3f518fcfaa77, skipping ID generation
2026-03-24 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8601ad7-3a34-53e6-943f-3f518fcfaa77 with scrape type 1
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8601ad7-3a34-53e6-943f-3f518fcfaa77 sending to next pipeline
2026-03-24 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f8601ad7-3a34-53e6-943f-3f518fcfaa77, identifier: 1981317
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1dc150>
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6c030-aa5f-5747-915a-a19e020fbde4/8ed6c030-aa5f-5747-915a-a19e020fbde4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F525%252Fcc12bf13f0fa49fd9b59c2f731df2fb4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/525/cc12bf13f0fa49fd9b59c2f731df2fb4/images/large/1.jpg saved to cache
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ed6c030-aa5f-5747-915a-a19e020fbde4
2026-03-24 18:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ed6c030-aa5f-5747-915a-a19e020fbde4, skipping ID generation
2026-03-24 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed6c030-aa5f-5747-915a-a19e020fbde4 with scrape type 1
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ed6c030-aa5f-5747-915a-a19e020fbde4 sending to next pipeline
2026-03-24 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ed6c030-aa5f-5747-915a-a19e020fbde4, identifier: 1981321
2026-03-24 18:32:30 [ayvens.es] INFO: Found listing with ID: 1981329
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981329%27 HTTP/1.1" 200 None
2026-03-24 18:32:30 [ayvens.es] INFO: Scrape type for 1981329: 1
2026-03-24 18:32:30 [ayvens.es] INFO: Extracting data for car ID: 1981329
2026-03-24 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1981329
2026-03-24 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with scrape type 1
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F57794ed880e149658625780e0cbe5a33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/57794ed880e149658625780e0cbe5a33/images/large/1.jpg not downloaded yet
2026-03-24 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1981317
2026-03-24 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1981317
2026-03-24 18:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1981317 to the API
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/107/f8f3139323e94778a93355af04fac0d6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Clear white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f8601ad7-3a34-53e6-943f-3f518fcfaa77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 49616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8601ad7-3a34-53e6-943f-3f518fcfaa77/f8601ad7-3a34-53e6-943f-3f518fcfaa77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/107/f8f3139323e94778a93355af04fac0d6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981317%27 HTTP/1.1" 200 None
2026-03-24 18:32:30 [ayvens.es] INFO: Saving data for 1981317: {'created_time': 1774377150.924205, 'last_price_update_time': 1774377150.924218, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981317') HTTP/1.1" 204 0
2026-03-24 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ed6c030-aa5f-5747-915a-a19e020fbde4 with identifier: 1981321
2026-03-24 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ed6c030-aa5f-5747-915a-a19e020fbde4 with identifier: 1981321
2026-03-24 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ed6c030-aa5f-5747-915a-a19e020fbde4 with identifier: 1981321 to the API
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/525/cc12bf13f0fa49fd9b59c2f731df2fb4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ed6c030-aa5f-5747-915a-a19e020fbde4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 85359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6c030-aa5f-5747-915a-a19e020fbde4/8ed6c030-aa5f-5747-915a-a19e020fbde4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/525/cc12bf13f0fa49fd9b59c2f731df2fb4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive30d',
 'transmission': 'manual',
 'trim': 'xDrive30d',
 'vin': None,
 'year': 2019}
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981321%27 HTTP/1.1" 200 None
2026-03-24 18:32:31 [ayvens.es] INFO: Saving data for 1981321: {'created_time': 1774377151.369252, 'last_price_update_time': 1774377151.369263, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981321') HTTP/1.1" 204 0
2026-03-24 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/b40beb6a0d1343fc92154cf4bf6353c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1dcbd0>
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a16029-39db-55f4-b512-bef98bbc8c00/d5a16029-39db-55f4-b512-bef98bbc8c00_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252Fdd5e7a2c58cc485f8b6c7cff364ababa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/dd5e7a2c58cc485f8b6c7cff364ababa/images/large/1.jpg saved to cache
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5a16029-39db-55f4-b512-bef98bbc8c00
2026-03-24 18:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5a16029-39db-55f4-b512-bef98bbc8c00, skipping ID generation
2026-03-24 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a16029-39db-55f4-b512-bef98bbc8c00 with scrape type 1
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5a16029-39db-55f4-b512-bef98bbc8c00 sending to next pipeline
2026-03-24 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5a16029-39db-55f4-b512-bef98bbc8c00, identifier: 1981319
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb70fd0>
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19811d5a-f341-58bf-a625-1f35d87f7ba8/19811d5a-f341-58bf-a625-1f35d87f7ba8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F99851fecf2fc41df8e4428090cd12e78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/99851fecf2fc41df8e4428090cd12e78/images/large/1.jpg saved to cache
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19811d5a-f341-58bf-a625-1f35d87f7ba8
2026-03-24 18:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19811d5a-f341-58bf-a625-1f35d87f7ba8, skipping ID generation
2026-03-24 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19811d5a-f341-58bf-a625-1f35d87f7ba8 with scrape type 1
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19811d5a-f341-58bf-a625-1f35d87f7ba8 sending to next pipeline
2026-03-24 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 19811d5a-f341-58bf-a625-1f35d87f7ba8, identifier: 1981318
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1d5e10>
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772ccc08-4770-55a8-9a32-53a52f27b854/772ccc08-4770-55a8-9a32-53a52f27b854_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F951%252F52c8824b3c02471991e28096fae468ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/951/52c8824b3c02471991e28096fae468ec/images/large/1.jpg saved to cache
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 772ccc08-4770-55a8-9a32-53a52f27b854
2026-03-24 18:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 772ccc08-4770-55a8-9a32-53a52f27b854, skipping ID generation
2026-03-24 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772ccc08-4770-55a8-9a32-53a52f27b854 with scrape type 1
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 772ccc08-4770-55a8-9a32-53a52f27b854 sending to next pipeline
2026-03-24 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 772ccc08-4770-55a8-9a32-53a52f27b854, identifier: 1981322
2026-03-24 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/302/0ceb9a2d4ae9418bb7856affe73abc43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:31 [ayvens.es] INFO: Found listing with ID: 1981330
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981330%27 HTTP/1.1" 200 None
2026-03-24 18:32:31 [ayvens.es] INFO: Scrape type for 1981330: 1
2026-03-24 18:32:31 [ayvens.es] INFO: Extracting data for car ID: 1981330
2026-03-24 18:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1981330
2026-03-24 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45798655-6898-52fc-a90c-205b76d32f28 with scrape type 1
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45798655-6898-52fc-a90c-205b76d32f28
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252Fcbd2a8ee2a464ff08c437d59ccd0ef29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/cbd2a8ee2a464ff08c437d59ccd0ef29/images/large/1.jpg not downloaded yet
2026-03-24 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1981319
2026-03-24 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1981319
2026-03-24 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1981319 to the API
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/561/dd5e7a2c58cc485f8b6c7cff364ababa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd5a16029-39db-55f4-b512-bef98bbc8c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 64840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a16029-39db-55f4-b512-bef98bbc8c00/d5a16029-39db-55f4-b512-bef98bbc8c00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/561/dd5e7a2c58cc485f8b6c7cff364ababa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981319%27 HTTP/1.1" 200 None
2026-03-24 18:32:32 [ayvens.es] INFO: Saving data for 1981319: {'created_time': 1774377152.20522, 'last_price_update_time': 1774377152.20523, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981319') HTTP/1.1" 204 0
2026-03-24 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1981318
2026-03-24 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1981318
2026-03-24 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1981318 to the API
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/99851fecf2fc41df8e4428090cd12e78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris magnetics',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '19811d5a-f341-58bf-a625-1f35d87f7ba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 81356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19811d5a-f341-58bf-a625-1f35d87f7ba8/19811d5a-f341-58bf-a625-1f35d87f7ba8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/99851fecf2fc41df8e4428090cd12e78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 2.0 TDI 110kW (150 CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150 CV)',
 'vin': None,
 'year': 2023}
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981318%27 HTTP/1.1" 200 None
2026-03-24 18:32:32 [ayvens.es] INFO: Saving data for 1981318: {'created_time': 1774377152.625286, 'last_price_update_time': 1774377152.625297, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981318') HTTP/1.1" 204 0
2026-03-24 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1981322
2026-03-24 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1981322
2026-03-24 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1981322 to the API
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/951/52c8824b3c02471991e28096fae468ec/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '772ccc08-4770-55a8-9a32-53a52f27b854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 80727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772ccc08-4770-55a8-9a32-53a52f27b854/772ccc08-4770-55a8-9a32-53a52f27b854_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/951/52c8824b3c02471991e28096fae468ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'vin': None,
 'year': 2023}
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981322%27 HTTP/1.1" 200 None
2026-03-24 18:32:32 [ayvens.es] INFO: Saving data for 1981322: {'created_time': 1774377152.963125, 'last_price_update_time': 1774377152.963136, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981322') HTTP/1.1" 204 0
2026-03-24 18:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/3c1f3ed651ff4065a399abbf99bf5110/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0ff990>
2026-03-24 18:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c2915e-35ca-507a-8eb0-b8809abfae4e/99c2915e-35ca-507a-8eb0-b8809abfae4e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F4be050196217493abd057324a4fafcf0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/4be050196217493abd057324a4fafcf0/images/large/1.jpg saved to cache
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99c2915e-35ca-507a-8eb0-b8809abfae4e
2026-03-24 18:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99c2915e-35ca-507a-8eb0-b8809abfae4e, skipping ID generation
2026-03-24 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c2915e-35ca-507a-8eb0-b8809abfae4e with scrape type 1
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99c2915e-35ca-507a-8eb0-b8809abfae4e sending to next pipeline
2026-03-24 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99c2915e-35ca-507a-8eb0-b8809abfae4e, identifier: 1981323
2026-03-24 18:32:33 [ayvens.es] INFO: Found listing with ID: 1981331
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981331%27 HTTP/1.1" 200 None
2026-03-24 18:32:33 [ayvens.es] INFO: Scrape type for 1981331: 1
2026-03-24 18:32:33 [ayvens.es] INFO: Extracting data for car ID: 1981331
2026-03-24 18:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321f571a-634d-517b-92f7-480563b77024 with identifier: 1981331
2026-03-24 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321f571a-634d-517b-92f7-480563b77024 with scrape type 1
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 321f571a-634d-517b-92f7-480563b77024
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F517%252F26ce3ce9860142c3897ab778dc09996a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/517/26ce3ce9860142c3897ab778dc09996a/images/large/1.jpg not downloaded yet
2026-03-24 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1981323
2026-03-24 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1981323
2026-03-24 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1981323 to the API
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/4be050196217493abd057324a4fafcf0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 18,
 'color': 'Rojo patagonia',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '99c2915e-35ca-507a-8eb0-b8809abfae4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 23976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c2915e-35ca-507a-8eb0-b8809abfae4e/99c2915e-35ca-507a-8eb0-b8809abfae4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/4be050196217493abd057324a4fafcf0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 250 e Sedan',
 'transmission': 'manual',
 'trim': 'A 250 e Sedan',
 'vin': None,
 'year': 2023}
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981323%27 HTTP/1.1" 200 None
2026-03-24 18:32:33 [ayvens.es] INFO: Saving data for 1981323: {'created_time': 1774377153.477804, 'last_price_update_time': 1774377153.477815, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981323') HTTP/1.1" 204 0
2026-03-24 18:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/a4ffce93807a476697c439a0ae22f8a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee31190>
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6070cc-16d4-5b77-8317-87d44ca08cb8/6b6070cc-16d4-5b77-8317-87d44ca08cb8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Fb40beb6a0d1343fc92154cf4bf6353c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/b40beb6a0d1343fc92154cf4bf6353c2/images/large/1.jpg saved to cache
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8
2026-03-24 18:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b6070cc-16d4-5b77-8317-87d44ca08cb8, skipping ID generation
2026-03-24 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with scrape type 1
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8 sending to next pipeline
2026-03-24 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6b6070cc-16d4-5b77-8317-87d44ca08cb8, identifier: 1981320
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1e9450>
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429b4528-74ec-5701-97b6-b3d9ac42a82d/429b4528-74ec-5701-97b6-b3d9ac42a82d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F0ceb9a2d4ae9418bb7856affe73abc43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/0ceb9a2d4ae9418bb7856affe73abc43/images/large/1.jpg saved to cache
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 429b4528-74ec-5701-97b6-b3d9ac42a82d
2026-03-24 18:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 429b4528-74ec-5701-97b6-b3d9ac42a82d, skipping ID generation
2026-03-24 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429b4528-74ec-5701-97b6-b3d9ac42a82d with scrape type 1
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 429b4528-74ec-5701-97b6-b3d9ac42a82d sending to next pipeline
2026-03-24 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 429b4528-74ec-5701-97b6-b3d9ac42a82d, identifier: 1981324
2026-03-24 18:32:33 [ayvens.es] INFO: Found listing with ID: 1981332
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981332%27 HTTP/1.1" 200 None
2026-03-24 18:32:33 [ayvens.es] INFO: Scrape type for 1981332: 1
2026-03-24 18:32:33 [ayvens.es] INFO: Extracting data for car ID: 1981332
2026-03-24 18:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 847e7957-d3fd-5613-a1d6-d089e12a5f64 with identifier: 1981332
2026-03-24 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 847e7957-d3fd-5613-a1d6-d089e12a5f64 with scrape type 1
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 847e7957-d3fd-5613-a1d6-d089e12a5f64
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F492547ba814245c7b5aac5db2d1563b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/492547ba814245c7b5aac5db2d1563b7/images/large/1.jpg not downloaded yet
2026-03-24 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1981320
2026-03-24 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1981320
2026-03-24 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1981320 to the API
2026-03-24 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/b40beb6a0d1343fc92154cf4bf6353c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6b6070cc-16d4-5b77-8317-87d44ca08cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 75722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6070cc-16d4-5b77-8317-87d44ca08cb8/6b6070cc-16d4-5b77-8317-87d44ca08cb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/b40beb6a0d1343fc92154cf4bf6353c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981320%27 HTTP/1.1" 200 None
2026-03-24 18:32:34 [ayvens.es] INFO: Saving data for 1981320: {'created_time': 1774377154.165123, 'last_price_update_time': 1774377154.16514, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981320') HTTP/1.1" 204 0
2026-03-24 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1981324
2026-03-24 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1981324
2026-03-24 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1981324 to the API
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/302/0ceb9a2d4ae9418bb7856affe73abc43/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Midnight black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '429b4528-74ec-5701-97b6-b3d9ac42a82d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 65839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429b4528-74ec-5701-97b6-b3d9ac42a82d/429b4528-74ec-5701-97b6-b3d9ac42a82d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/302/0ceb9a2d4ae9418bb7856affe73abc43/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981324%27 HTTP/1.1" 200 None
2026-03-24 18:32:34 [ayvens.es] INFO: Saving data for 1981324: {'created_time': 1774377154.480588, 'last_price_update_time': 1774377154.480601, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981324') HTTP/1.1" 204 0
2026-03-24 18:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed35dd0>
2026-03-24 18:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e774bdd-132a-5e57-a8d6-65f0d82d0c6b/5e774bdd-132a-5e57-a8d6-65f0d82d0c6b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F3c1f3ed651ff4065a399abbf99bf5110%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/3c1f3ed651ff4065a399abbf99bf5110/images/large/1.jpg saved to cache
2026-03-24 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b
2026-03-24 18:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b, skipping ID generation
2026-03-24 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b with scrape type 1
2026-03-24 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b sending to next pipeline
2026-03-24 18:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b, identifier: 1981325
2026-03-24 18:32:34 [ayvens.es] INFO: Found listing with ID: 1981333
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981333%27 HTTP/1.1" 200 None
2026-03-24 18:32:34 [ayvens.es] INFO: Scrape type for 1981333: 1
2026-03-24 18:32:34 [ayvens.es] INFO: Extracting data for car ID: 1981333
2026-03-24 18:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1981333
2026-03-24 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with scrape type 1
2026-03-24 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252Fdbacde3cc02a4e658b39adc20c7ebbfc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/dbacde3cc02a4e658b39adc20c7ebbfc/images/large/1.jpg not downloaded yet
2026-03-24 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b with identifier: 1981325
2026-03-24 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b with identifier: 1981325
2026-03-24 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5e774bdd-132a-5e57-a8d6-65f0d82d0c6b with identifier: 1981325 to the API
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/3c1f3ed651ff4065a399abbf99bf5110/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Bluefire blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5e774bdd-132a-5e57-a8d6-65f0d82d0c6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 45973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e774bdd-132a-5e57-a8d6-65f0d82d0c6b/5e774bdd-132a-5e57-a8d6-65f0d82d0c6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/3c1f3ed651ff4065a399abbf99bf5110/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0D 120kW',
 'transmission': 'manual',
 'trim': '2.0D 120kW',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981325%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [ayvens.es] INFO: Saving data for 1981325: {'created_time': 1774377155.007591, 'last_price_update_time': 1774377155.007601, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981325') HTTP/1.1" 204 0
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee23d090>
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe404f7-a33b-5c4a-9cfb-268b4a54b48c/efe404f7-a33b-5c4a-9cfb-268b4a54b48c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Fa4ffce93807a476697c439a0ae22f8a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/a4ffce93807a476697c439a0ae22f8a3/images/large/1.jpg saved to cache
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efe404f7-a33b-5c4a-9cfb-268b4a54b48c, skipping ID generation
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c sending to next pipeline
2026-03-24 18:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: efe404f7-a33b-5c4a-9cfb-268b4a54b48c, identifier: 1981326
2026-03-24 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1981326
2026-03-24 18:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1981326
2026-03-24 18:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1981326 to the API
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/a4ffce93807a476697c439a0ae22f8a3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'efe404f7-a33b-5c4a-9cfb-268b4a54b48c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 CACTUS',
 'odometer': 86950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe404f7-a33b-5c4a-9cfb-268b4a54b48c/efe404f7-a33b-5c4a-9cfb-268b4a54b48c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/a4ffce93807a476697c439a0ae22f8a3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 CACTUS BlueHDi 100 S&S Shine',
 'transmission': 'manual',
 'trim': 'BlueHDi 100 S&S Shine',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981326%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [ayvens.es] INFO: Saving data for 1981326: {'created_time': 1774377155.432952, 'last_price_update_time': 1774377155.432962, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981326') HTTP/1.1" 204 0
2026-03-24 18:32:35 [ayvens.es] INFO: Found listing with ID: 1981334
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981334%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [ayvens.es] INFO: Scrape type for 1981334: 1
2026-03-24 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1981334
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1981334
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6d108b-9a9a-5bb1-9631-fe8001528410 with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6d6d108b-9a9a-5bb1-9631-fe8001528410
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252F44792c9974e84cedbe58f05ab99238ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/44792c9974e84cedbe58f05ab99238ae/images/large/1.jpg not downloaded yet
2026-03-24 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/568/51b06150bb8d469db682217546cab688/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/061/57794ed880e149658625780e0cbe5a33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:35 [ayvens.es] INFO: Found listing with ID: 1981335
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981335%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [ayvens.es] INFO: Scrape type for 1981335: 1
2026-03-24 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1981335
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1981335
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252Fd04d441e05074898b35600dc078f2c6c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/d04d441e05074898b35600dc078f2c6c/images/large/1.jpg not downloaded yet
2026-03-24 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/608/3da18740da9e488597cbcaf85decc353/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/706/cbd2a8ee2a464ff08c437d59ccd0ef29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:35 [ayvens.es] INFO: Found listing with ID: 1981336
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981336%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [ayvens.es] INFO: Scrape type for 1981336: 1
2026-03-24 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1981336
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1981336
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430ee523-364a-5149-bac6-d0437e7b6a99 with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 430ee523-364a-5149-bac6-d0437e7b6a99
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F291%252F9c5da5f5a8954160a7aec340189fce30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/291/9c5da5f5a8954160a7aec340189fce30/images/large/1.jpg not downloaded yet
2026-03-24 18:32:35 [ayvens.es] INFO: Found listing with ID: 1981337
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981337%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [ayvens.es] INFO: Scrape type for 1981337: 1
2026-03-24 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1981337
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1981337
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26a01f7-b072-500a-80a8-6ab01f7025b2 with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a26a01f7-b072-500a-80a8-6ab01f7025b2
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252F6313c57c4bb449958fd55492a6b12398%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/6313c57c4bb449958fd55492a6b12398/images/large/1.jpg not downloaded yet
2026-03-24 18:32:35 [ayvens.es] INFO: Found listing with ID: 1981338
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981338%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [ayvens.es] INFO: Scrape type for 1981338: 1
2026-03-24 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1981338
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1981338
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a350417e-46b5-5412-b8fc-289aaf9c736c with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a350417e-46b5-5412-b8fc-289aaf9c736c
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fa5c48a7edcde4ab98de1d35e97e8bece%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/a5c48a7edcde4ab98de1d35e97e8bece/images/large/1.jpg not downloaded yet
2026-03-24 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/409/492547ba814245c7b5aac5db2d1563b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1d4190>
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be3df49-2678-5a39-a904-3d9aaf57e49d/6be3df49-2678-5a39-a904-3d9aaf57e49d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F568%252F51b06150bb8d469db682217546cab688%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/568/51b06150bb8d469db682217546cab688/images/large/1.jpg saved to cache
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6be3df49-2678-5a39-a904-3d9aaf57e49d
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6be3df49-2678-5a39-a904-3d9aaf57e49d, skipping ID generation
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be3df49-2678-5a39-a904-3d9aaf57e49d with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6be3df49-2678-5a39-a904-3d9aaf57e49d sending to next pipeline
2026-03-24 18:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6be3df49-2678-5a39-a904-3d9aaf57e49d, identifier: 1981327
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea658d0>
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc/ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F57794ed880e149658625780e0cbe5a33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/57794ed880e149658625780e0cbe5a33/images/large/1.jpg saved to cache
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc
2026-03-24 18:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc, skipping ID generation
2026-03-24 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with scrape type 1
2026-03-24 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc sending to next pipeline
2026-03-24 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc, identifier: 1981329
2026-03-24 18:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/517/26ce3ce9860142c3897ab778dc09996a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:36 [ayvens.es] INFO: Found listing with ID: 1981339
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981339%27 HTTP/1.1" 200 None
2026-03-24 18:32:36 [ayvens.es] INFO: Scrape type for 1981339: 1
2026-03-24 18:32:36 [ayvens.es] INFO: Extracting data for car ID: 1981339
2026-03-24 18:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1981339
2026-03-24 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e8131d-eccb-5269-8874-ae528d74bfd8 with scrape type 1
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6e8131d-eccb-5269-8874-ae528d74bfd8
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252F7fe3cfe3e40e45ce9ae9f0cff100b3d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/7fe3cfe3e40e45ce9ae9f0cff100b3d9/images/large/1.jpg not downloaded yet
2026-03-24 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6be3df49-2678-5a39-a904-3d9aaf57e49d with identifier: 1981327
2026-03-24 18:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6be3df49-2678-5a39-a904-3d9aaf57e49d with identifier: 1981327
2026-03-24 18:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6be3df49-2678-5a39-a904-3d9aaf57e49d with identifier: 1981327 to the API
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/568/51b06150bb8d469db682217546cab688/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6be3df49-2678-5a39-a904-3d9aaf57e49d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 77347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be3df49-2678-5a39-a904-3d9aaf57e49d/6be3df49-2678-5a39-a904-3d9aaf57e49d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/568/51b06150bb8d469db682217546cab688/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981327%27 HTTP/1.1" 200 None
2026-03-24 18:32:36 [ayvens.es] INFO: Saving data for 1981327: {'created_time': 1774377156.306371, 'last_price_update_time': 1774377156.306383, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981327') HTTP/1.1" 204 0
2026-03-24 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1981329
2026-03-24 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1981329
2026-03-24 18:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1981329 to the API
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/061/57794ed880e149658625780e0cbe5a33/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Gris selenita magno',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 73477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc/ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/061/57794ed880e149658625780e0cbe5a33/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 200',
 'transmission': 'manual',
 'trim': 'C 200',
 'vin': None,
 'year': 2019}
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981329%27 HTTP/1.1" 200 None
2026-03-24 18:32:36 [ayvens.es] INFO: Saving data for 1981329: {'created_time': 1774377156.679766, 'last_price_update_time': 1774377156.679776, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981329') HTTP/1.1" 204 0
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee96a4d0>
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d9bfa44-9ad1-52db-8969-ef1904c2d128/2d9bfa44-9ad1-52db-8969-ef1904c2d128_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F608%252F3da18740da9e488597cbcaf85decc353%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/608/3da18740da9e488597cbcaf85decc353/images/large/1.jpg saved to cache
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d9bfa44-9ad1-52db-8969-ef1904c2d128
2026-03-24 18:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d9bfa44-9ad1-52db-8969-ef1904c2d128, skipping ID generation
2026-03-24 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d9bfa44-9ad1-52db-8969-ef1904c2d128 with scrape type 1
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d9bfa44-9ad1-52db-8969-ef1904c2d128 sending to next pipeline
2026-03-24 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2d9bfa44-9ad1-52db-8969-ef1904c2d128, identifier: 1981328
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea0b190>
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45798655-6898-52fc-a90c-205b76d32f28/45798655-6898-52fc-a90c-205b76d32f28_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252Fcbd2a8ee2a464ff08c437d59ccd0ef29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/cbd2a8ee2a464ff08c437d59ccd0ef29/images/large/1.jpg saved to cache
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45798655-6898-52fc-a90c-205b76d32f28
2026-03-24 18:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45798655-6898-52fc-a90c-205b76d32f28, skipping ID generation
2026-03-24 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45798655-6898-52fc-a90c-205b76d32f28 with scrape type 1
2026-03-24 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45798655-6898-52fc-a90c-205b76d32f28 sending to next pipeline
2026-03-24 18:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45798655-6898-52fc-a90c-205b76d32f28, identifier: 1981330
2026-03-24 18:32:37 [ayvens.es] INFO: Found listing with ID: 1981340
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981340%27 HTTP/1.1" 200 None
2026-03-24 18:32:37 [ayvens.es] INFO: Scrape type for 1981340: 1
2026-03-24 18:32:37 [ayvens.es] INFO: Extracting data for car ID: 1981340
2026-03-24 18:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1981340
2026-03-24 18:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afdf6c14-8967-584b-a25d-0a1b3722109d with scrape type 1
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afdf6c14-8967-584b-a25d-0a1b3722109d
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F665%252Fc896e52707ab4d6e97de3b217df55fa8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/665/c896e52707ab4d6e97de3b217df55fa8/images/large/1.jpg not downloaded yet
2026-03-24 18:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2d9bfa44-9ad1-52db-8969-ef1904c2d128 with identifier: 1981328
2026-03-24 18:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2d9bfa44-9ad1-52db-8969-ef1904c2d128 with identifier: 1981328
2026-03-24 18:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2d9bfa44-9ad1-52db-8969-ef1904c2d128 with identifier: 1981328 to the API
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/608/3da18740da9e488597cbcaf85decc353/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2d9bfa44-9ad1-52db-8969-ef1904c2d128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 14364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d9bfa44-9ad1-52db-8969-ef1904c2d128/2d9bfa44-9ad1-52db-8969-ef1904c2d128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/608/3da18740da9e488597cbcaf85decc353/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO Stepway Essential TCE 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Stepway Essential TCE 66kW (90CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981328%27 HTTP/1.1" 200 None
2026-03-24 18:32:37 [ayvens.es] INFO: Saving data for 1981328: {'created_time': 1774377157.351703, 'last_price_update_time': 1774377157.351714, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981328') HTTP/1.1" 204 0
2026-03-24 18:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1981330
2026-03-24 18:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1981330
2026-03-24 18:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1981330 to the API
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/706/cbd2a8ee2a464ff08c437d59ccd0ef29/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '45798655-6898-52fc-a90c-205b76d32f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 124473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45798655-6898-52fc-a90c-205b76d32f28/45798655-6898-52fc-a90c-205b76d32f28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/706/cbd2a8ee2a464ff08c437d59ccd0ef29/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 CDTi Ultimate Auto',
 'transmission': 'manual',
 'trim': '1.5 CDTi Ultimate Auto',
 'vin': None,
 'year': 2019}
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981330%27 HTTP/1.1" 200 None
2026-03-24 18:32:37 [ayvens.es] INFO: Saving data for 1981330: {'created_time': 1774377157.670216, 'last_price_update_time': 1774377157.670227, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981330') HTTP/1.1" 204 0
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05cfad0>
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_847e7957-d3fd-5613-a1d6-d089e12a5f64/847e7957-d3fd-5613-a1d6-d089e12a5f64_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F492547ba814245c7b5aac5db2d1563b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/492547ba814245c7b5aac5db2d1563b7/images/large/1.jpg saved to cache
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 847e7957-d3fd-5613-a1d6-d089e12a5f64
2026-03-24 18:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 847e7957-d3fd-5613-a1d6-d089e12a5f64, skipping ID generation
2026-03-24 18:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 847e7957-d3fd-5613-a1d6-d089e12a5f64 with scrape type 1
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 847e7957-d3fd-5613-a1d6-d089e12a5f64 sending to next pipeline
2026-03-24 18:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 847e7957-d3fd-5613-a1d6-d089e12a5f64, identifier: 1981332
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee708290>
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321f571a-634d-517b-92f7-480563b77024/321f571a-634d-517b-92f7-480563b77024_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F517%252F26ce3ce9860142c3897ab778dc09996a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/517/26ce3ce9860142c3897ab778dc09996a/images/large/1.jpg saved to cache
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 321f571a-634d-517b-92f7-480563b77024
2026-03-24 18:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 321f571a-634d-517b-92f7-480563b77024, skipping ID generation
2026-03-24 18:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321f571a-634d-517b-92f7-480563b77024 with scrape type 1
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 321f571a-634d-517b-92f7-480563b77024 sending to next pipeline
2026-03-24 18:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 321f571a-634d-517b-92f7-480563b77024, identifier: 1981331
2026-03-24 18:32:37 [ayvens.es] INFO: Found listing with ID: 1981341
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981341%27 HTTP/1.1" 200 None
2026-03-24 18:32:37 [ayvens.es] INFO: Scrape type for 1981341: 1
2026-03-24 18:32:37 [ayvens.es] INFO: Extracting data for car ID: 1981341
2026-03-24 18:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e903ed3f-331b-57c5-a9c9-ed79ecf51b89 with identifier: 1981341
2026-03-24 18:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e903ed3f-331b-57c5-a9c9-ed79ecf51b89 with scrape type 1
2026-03-24 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e903ed3f-331b-57c5-a9c9-ed79ecf51b89
2026-03-24 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252Fc62340bc1581499a943e7beca4e6f390%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/c62340bc1581499a943e7beca4e6f390/images/large/1.jpg not downloaded yet
2026-03-24 18:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 847e7957-d3fd-5613-a1d6-d089e12a5f64 with identifier: 1981332
2026-03-24 18:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 847e7957-d3fd-5613-a1d6-d089e12a5f64 with identifier: 1981332
2026-03-24 18:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 847e7957-d3fd-5613-a1d6-d089e12a5f64 with identifier: 1981332 to the API
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/409/492547ba814245c7b5aac5db2d1563b7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '847e7957-d3fd-5613-a1d6-d089e12a5f64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 157668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_847e7957-d3fd-5613-a1d6-d089e12a5f64/847e7957-d3fd-5613-a1d6-d089e12a5f64_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/492547ba814245c7b5aac5db2d1563b7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 TDCi E6 120cv Trend+',
 'transmission': 'manual',
 'trim': '1.5 TDCi E6 120cv Trend+',
 'vin': None,
 'year': 2016}
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981332%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [ayvens.es] INFO: Saving data for 1981332: {'created_time': 1774377158.293799, 'last_price_update_time': 1774377158.29381, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981332') HTTP/1.1" 204 0
2026-03-24 18:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 321f571a-634d-517b-92f7-480563b77024 with identifier: 1981331
2026-03-24 18:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 321f571a-634d-517b-92f7-480563b77024 with identifier: 1981331
2026-03-24 18:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 321f571a-634d-517b-92f7-480563b77024 with identifier: 1981331 to the API
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/517/26ce3ce9860142c3897ab778dc09996a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '321f571a-634d-517b-92f7-480563b77024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C5 AIRCROSS',
 'odometer': 22628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321f571a-634d-517b-92f7-480563b77024/321f571a-634d-517b-92f7-480563b77024_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/517/26ce3ce9860142c3897ab778dc09996a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C5 AIRCROSS 225 e-EAT8 Feel',
 'transmission': 'manual',
 'trim': '225 e-EAT8 Feel',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981331%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [ayvens.es] INFO: Saving data for 1981331: {'created_time': 1774377158.755394, 'last_price_update_time': 1774377158.755409, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981331') HTTP/1.1" 204 0
2026-03-24 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/846/dbacde3cc02a4e658b39adc20c7ebbfc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/012/d04d441e05074898b35600dc078f2c6c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/291/9c5da5f5a8954160a7aec340189fce30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/765/44792c9974e84cedbe58f05ab99238ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:38 [ayvens.es] INFO: Found listing with ID: 1981342
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981342%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [ayvens.es] INFO: Scrape type for 1981342: 1
2026-03-24 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1981342
2026-03-24 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a733a1b7-0218-5a77-a44c-c379c8a2e93a with identifier: 1981342
2026-03-24 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a733a1b7-0218-5a77-a44c-c379c8a2e93a with scrape type 1
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a733a1b7-0218-5a77-a44c-c379c8a2e93a
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252Fe0b64ea2f9904470b79e3ec3256395be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/e0b64ea2f9904470b79e3ec3256395be/images/large/1.jpg not downloaded yet
2026-03-24 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/a5c48a7edcde4ab98de1d35e97e8bece/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:38 [ayvens.es] INFO: Found listing with ID: 1981343
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981343%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [ayvens.es] INFO: Scrape type for 1981343: 1
2026-03-24 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1981343
2026-03-24 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1981343
2026-03-24 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with scrape type 1
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F658%252Fab42cf67e83e44a1bca5514c155df412%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/658/ab42cf67e83e44a1bca5514c155df412/images/large/1.jpg not downloaded yet
2026-03-24 18:32:38 [ayvens.es] INFO: Found listing with ID: 1981344
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981344%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [ayvens.es] INFO: Scrape type for 1981344: 1
2026-03-24 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1981344
2026-03-24 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1981344
2026-03-24 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca97f27-712f-5a0f-b8be-6b3bddef395c with scrape type 1
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bca97f27-712f-5a0f-b8be-6b3bddef395c
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F90d5cc47b19a47f9b5b05e46df0bdd48%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/90d5cc47b19a47f9b5b05e46df0bdd48/images/large/1.jpg not downloaded yet
2026-03-24 18:32:38 [ayvens.es] INFO: Found listing with ID: 1981345
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981345%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [ayvens.es] INFO: Scrape type for 1981345: 1
2026-03-24 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1981345
2026-03-24 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1981345
2026-03-24 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29242d21-ada0-56e9-bf11-c96cc899b08a with scrape type 1
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29242d21-ada0-56e9-bf11-c96cc899b08a
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F121%252Fdd28d8a660c147e79d42d9dc4b03962f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/121/dd28d8a660c147e79d42d9dc4b03962f/images/large/1.jpg not downloaded yet
2026-03-24 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/760/6313c57c4bb449958fd55492a6b12398/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb0a310>
2026-03-24 18:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8/3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252Fdbacde3cc02a4e658b39adc20c7ebbfc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/dbacde3cc02a4e658b39adc20c7ebbfc/images/large/1.jpg saved to cache
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8
2026-03-24 18:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8, skipping ID generation
2026-03-24 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with scrape type 1
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 sending to next pipeline
2026-03-24 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8, identifier: 1981333
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9f95d0>
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba80ec6-5687-5004-9b13-c43f9e42ea5c/5ba80ec6-5687-5004-9b13-c43f9e42ea5c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252Fd04d441e05074898b35600dc078f2c6c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/d04d441e05074898b35600dc078f2c6c/images/large/1.jpg saved to cache
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c
2026-03-24 18:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c, skipping ID generation
2026-03-24 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with scrape type 1
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c sending to next pipeline
2026-03-24 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c, identifier: 1981335
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea32790>
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430ee523-364a-5149-bac6-d0437e7b6a99/430ee523-364a-5149-bac6-d0437e7b6a99_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F291%252F9c5da5f5a8954160a7aec340189fce30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/291/9c5da5f5a8954160a7aec340189fce30/images/large/1.jpg saved to cache
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 430ee523-364a-5149-bac6-d0437e7b6a99
2026-03-24 18:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 430ee523-364a-5149-bac6-d0437e7b6a99, skipping ID generation
2026-03-24 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430ee523-364a-5149-bac6-d0437e7b6a99 with scrape type 1
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 430ee523-364a-5149-bac6-d0437e7b6a99 sending to next pipeline
2026-03-24 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 430ee523-364a-5149-bac6-d0437e7b6a99, identifier: 1981336
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7fa390>
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6d108b-9a9a-5bb1-9631-fe8001528410/6d6d108b-9a9a-5bb1-9631-fe8001528410_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252F44792c9974e84cedbe58f05ab99238ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/44792c9974e84cedbe58f05ab99238ae/images/large/1.jpg saved to cache
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d6d108b-9a9a-5bb1-9631-fe8001528410
2026-03-24 18:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d6d108b-9a9a-5bb1-9631-fe8001528410, skipping ID generation
2026-03-24 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6d108b-9a9a-5bb1-9631-fe8001528410 with scrape type 1
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d6d108b-9a9a-5bb1-9631-fe8001528410 sending to next pipeline
2026-03-24 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6d6d108b-9a9a-5bb1-9631-fe8001528410, identifier: 1981334
2026-03-24 18:32:39 [ayvens.es] INFO: Found listing with ID: 1981346
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981346%27 HTTP/1.1" 200 None
2026-03-24 18:32:39 [ayvens.es] INFO: Scrape type for 1981346: 1
2026-03-24 18:32:39 [ayvens.es] INFO: Extracting data for car ID: 1981346
2026-03-24 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1166059d-a88e-5611-aa35-76240059ebb4 with identifier: 1981346
2026-03-24 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1166059d-a88e-5611-aa35-76240059ebb4 with scrape type 1
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1166059d-a88e-5611-aa35-76240059ebb4
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F396%252Fa42766a9784144b7946d585c54ffa74f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/396/a42766a9784144b7946d585c54ffa74f/images/large/1.jpg not downloaded yet
2026-03-24 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1981333
2026-03-24 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1981333
2026-03-24 18:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1981333 to the API
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/846/dbacde3cc02a4e658b39adc20c7ebbfc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Mineralweiss',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 81660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8/3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/846/dbacde3cc02a4e658b39adc20c7ebbfc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 330e',
 'transmission': 'manual',
 'trim': '330e',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981333%27 HTTP/1.1" 200 None
2026-03-24 18:32:39 [ayvens.es] INFO: Saving data for 1981333: {'created_time': 1774377159.952109, 'last_price_update_time': 1774377159.952123, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981333') HTTP/1.1" 204 0
2026-03-24 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1981335
2026-03-24 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1981335
2026-03-24 18:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1981335 to the API
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/012/d04d441e05074898b35600dc078f2c6c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ba80ec6-5687-5004-9b13-c43f9e42ea5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 84054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba80ec6-5687-5004-9b13-c43f9e42ea5c/5ba80ec6-5687-5004-9b13-c43f9e42ea5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/012/d04d441e05074898b35600dc078f2c6c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981335%27 HTTP/1.1" 200 None
2026-03-24 18:32:40 [ayvens.es] INFO: Saving data for 1981335: {'created_time': 1774377160.251823, 'last_price_update_time': 1774377160.251834, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981335') HTTP/1.1" 204 0
2026-03-24 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1981336
2026-03-24 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1981336
2026-03-24 18:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1981336 to the API
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/291/9c5da5f5a8954160a7aec340189fce30/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Azul met',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '430ee523-364a-5149-bac6-d0437e7b6a99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 86889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430ee523-364a-5149-bac6-d0437e7b6a99/430ee523-364a-5149-bac6-d0437e7b6a99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/291/9c5da5f5a8954160a7aec340189fce30/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Titanium HEV AT SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Titanium HEV AT SB',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981336%27 HTTP/1.1" 200 None
2026-03-24 18:32:40 [ayvens.es] INFO: Saving data for 1981336: {'created_time': 1774377160.53234, 'last_price_update_time': 1774377160.532351, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981336') HTTP/1.1" 204 0
2026-03-24 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1981334
2026-03-24 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1981334
2026-03-24 18:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1981334 to the API
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/765/44792c9974e84cedbe58f05ab99238ae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Plata iridio',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6d6d108b-9a9a-5bb1-9631-fe8001528410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 39712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6d108b-9a9a-5bb1-9631-fe8001528410/6d6d108b-9a9a-5bb1-9631-fe8001528410_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/765/44792c9974e84cedbe58f05ab99238ae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981334%27 HTTP/1.1" 200 None
2026-03-24 18:32:40 [ayvens.es] INFO: Saving data for 1981334: {'created_time': 1774377160.892782, 'last_price_update_time': 1774377160.892792, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981334') HTTP/1.1" 204 0
2026-03-24 18:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeedad10>
2026-03-24 18:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350417e-46b5-5412-b8fc-289aaf9c736c/a350417e-46b5-5412-b8fc-289aaf9c736c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fa5c48a7edcde4ab98de1d35e97e8bece%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/a5c48a7edcde4ab98de1d35e97e8bece/images/large/1.jpg saved to cache
2026-03-24 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a350417e-46b5-5412-b8fc-289aaf9c736c
2026-03-24 18:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a350417e-46b5-5412-b8fc-289aaf9c736c, skipping ID generation
2026-03-24 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a350417e-46b5-5412-b8fc-289aaf9c736c with scrape type 1
2026-03-24 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a350417e-46b5-5412-b8fc-289aaf9c736c sending to next pipeline
2026-03-24 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a350417e-46b5-5412-b8fc-289aaf9c736c, identifier: 1981338
2026-03-24 18:32:41 [ayvens.es] INFO: Found listing with ID: 1981347
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981347%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [ayvens.es] INFO: Scrape type for 1981347: 1
2026-03-24 18:32:41 [ayvens.es] INFO: Extracting data for car ID: 1981347
2026-03-24 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 583bd61d-901b-5542-b9b5-d1343114f8ab with identifier: 1981347
2026-03-24 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 583bd61d-901b-5542-b9b5-d1343114f8ab with scrape type 1
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 583bd61d-901b-5542-b9b5-d1343114f8ab
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252Fcf026fdd71ef4596b0442a67eb1e76a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/cf026fdd71ef4596b0442a67eb1e76a4/images/large/1.jpg not downloaded yet
2026-03-24 18:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1981338
2026-03-24 18:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1981338
2026-03-24 18:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1981338 to the API
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/389/a5c48a7edcde4ab98de1d35e97e8bece/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a350417e-46b5-5412-b8fc-289aaf9c736c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 78284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350417e-46b5-5412-b8fc-289aaf9c736c/a350417e-46b5-5412-b8fc-289aaf9c736c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/a5c48a7edcde4ab98de1d35e97e8bece/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981338%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [ayvens.es] INFO: Saving data for 1981338: {'created_time': 1774377161.356046, 'last_price_update_time': 1774377161.356057, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981338') HTTP/1.1" 204 0
2026-03-24 18:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee829050>
2026-03-24 18:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26a01f7-b072-500a-80a8-6ab01f7025b2/a26a01f7-b072-500a-80a8-6ab01f7025b2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252F6313c57c4bb449958fd55492a6b12398%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/6313c57c4bb449958fd55492a6b12398/images/large/1.jpg saved to cache
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a26a01f7-b072-500a-80a8-6ab01f7025b2
2026-03-24 18:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a26a01f7-b072-500a-80a8-6ab01f7025b2, skipping ID generation
2026-03-24 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26a01f7-b072-500a-80a8-6ab01f7025b2 with scrape type 1
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a26a01f7-b072-500a-80a8-6ab01f7025b2 sending to next pipeline
2026-03-24 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a26a01f7-b072-500a-80a8-6ab01f7025b2, identifier: 1981337
2026-03-24 18:32:41 [ayvens.es] INFO: Found listing with ID: 1981348
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981348%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [ayvens.es] INFO: Scrape type for 1981348: 1
2026-03-24 18:32:41 [ayvens.es] INFO: Extracting data for car ID: 1981348
2026-03-24 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1981348
2026-03-24 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90f410f-3080-5ff0-90f8-7decd650d0e3 with scrape type 1
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a90f410f-3080-5ff0-90f8-7decd650d0e3
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F941%252F4f2c7491db1341a7bc6a074d2448899f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/941/4f2c7491db1341a7bc6a074d2448899f/images/large/1.jpg not downloaded yet
2026-03-24 18:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1981337
2026-03-24 18:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1981337
2026-03-24 18:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1981337 to the API
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/760/6313c57c4bb449958fd55492a6b12398/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a26a01f7-b072-500a-80a8-6ab01f7025b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 86809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26a01f7-b072-500a-80a8-6ab01f7025b2/a26a01f7-b072-500a-80a8-6ab01f7025b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/760/6313c57c4bb449958fd55492a6b12398/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 75KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 75KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981337%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [ayvens.es] INFO: Saving data for 1981337: {'created_time': 1774377161.876048, 'last_price_update_time': 1774377161.876058, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981337') HTTP/1.1" 204 0
2026-03-24 18:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/665/c896e52707ab4d6e97de3b217df55fa8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:41 [ayvens.es] INFO: Found listing with ID: 1981349
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981349%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [ayvens.es] INFO: Scrape type for 1981349: 1
2026-03-24 18:32:41 [ayvens.es] INFO: Extracting data for car ID: 1981349
2026-03-24 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1981349
2026-03-24 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with scrape type 1
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252Fa0bea85657ef4a07b29d7001c7845353%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/a0bea85657ef4a07b29d7001c7845353/images/large/1.jpg not downloaded yet
2026-03-24 18:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/774/c62340bc1581499a943e7beca4e6f390/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/90d5cc47b19a47f9b5b05e46df0bdd48/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/924/7fe3cfe3e40e45ce9ae9f0cff100b3d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/316/e0b64ea2f9904470b79e3ec3256395be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:41 [ayvens.es] INFO: Found listing with ID: 1981350
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981350%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [ayvens.es] INFO: Scrape type for 1981350: 1
2026-03-24 18:32:41 [ayvens.es] INFO: Extracting data for car ID: 1981350
2026-03-24 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1981350
2026-03-24 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612c972f-89f0-5e93-80d8-77912a342d36 with scrape type 1
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 612c972f-89f0-5e93-80d8-77912a342d36
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F084%252Fa3a505b16b854a189631349946b9cfb2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/084/a3a505b16b854a189631349946b9cfb2/images/large/1.jpg not downloaded yet
2026-03-24 18:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/658/ab42cf67e83e44a1bca5514c155df412/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:41 [ayvens.es] INFO: Found listing with ID: 1981351
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981351%27 HTTP/1.1" 200 None
2026-03-24 18:32:41 [ayvens.es] INFO: Scrape type for 1981351: 1
2026-03-24 18:32:41 [ayvens.es] INFO: Extracting data for car ID: 1981351
2026-03-24 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1981351
2026-03-24 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75265a9-305c-5c84-bf41-4fbfce833b43 with scrape type 1
2026-03-24 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d75265a9-305c-5c84-bf41-4fbfce833b43
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F728%252F555b5c6653964dcdbcca5c2663c7b097%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/728/555b5c6653964dcdbcca5c2663c7b097/images/large/1.jpg not downloaded yet
2026-03-24 18:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/121/dd28d8a660c147e79d42d9dc4b03962f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:42 [ayvens.es] INFO: Found listing with ID: 1981352
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981352%27 HTTP/1.1" 200 None
2026-03-24 18:32:42 [ayvens.es] INFO: Scrape type for 1981352: 1
2026-03-24 18:32:42 [ayvens.es] INFO: Extracting data for car ID: 1981352
2026-03-24 18:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1981352
2026-03-24 18:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 140b7b10-5cef-5137-a710-a45963521a81 with scrape type 1
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 140b7b10-5cef-5137-a710-a45963521a81
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Fe35324ffd5124dbeaa66b41afa4de168%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/e35324ffd5124dbeaa66b41afa4de168/images/large/1.jpg not downloaded yet
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee828290>
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afdf6c14-8967-584b-a25d-0a1b3722109d/afdf6c14-8967-584b-a25d-0a1b3722109d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F665%252Fc896e52707ab4d6e97de3b217df55fa8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/665/c896e52707ab4d6e97de3b217df55fa8/images/large/1.jpg saved to cache
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afdf6c14-8967-584b-a25d-0a1b3722109d
2026-03-24 18:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afdf6c14-8967-584b-a25d-0a1b3722109d, skipping ID generation
2026-03-24 18:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afdf6c14-8967-584b-a25d-0a1b3722109d with scrape type 1
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afdf6c14-8967-584b-a25d-0a1b3722109d sending to next pipeline
2026-03-24 18:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: afdf6c14-8967-584b-a25d-0a1b3722109d, identifier: 1981340
2026-03-24 18:32:42 [ayvens.es] INFO: Found listing with ID: 1981353
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981353%27 HTTP/1.1" 200 None
2026-03-24 18:32:42 [ayvens.es] INFO: Scrape type for 1981353: 1
2026-03-24 18:32:42 [ayvens.es] INFO: Extracting data for car ID: 1981353
2026-03-24 18:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 680c2be6-3c45-5f5a-b1ef-51e7b4dece25 with identifier: 1981353
2026-03-24 18:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680c2be6-3c45-5f5a-b1ef-51e7b4dece25 with scrape type 1
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 680c2be6-3c45-5f5a-b1ef-51e7b4dece25
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F197%252F9cce480cff5c482a88b4830db14b1215%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/197/9cce480cff5c482a88b4830db14b1215/images/large/1.jpg not downloaded yet
2026-03-24 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1981340
2026-03-24 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1981340
2026-03-24 18:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1981340 to the API
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/665/c896e52707ab4d6e97de3b217df55fa8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Azul chrome',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'afdf6c14-8967-584b-a25d-0a1b3722109d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 50199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afdf6c14-8967-584b-a25d-0a1b3722109d/afdf6c14-8967-584b-a25d-0a1b3722109d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/665/c896e52707ab4d6e97de3b217df55fa8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line X 2.5 Duratec FHEV Auto',
 'transmission': 'manual',
 'trim': 'ST-Line X 2.5 Duratec FHEV Auto',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981340%27 HTTP/1.1" 200 None
2026-03-24 18:32:42 [ayvens.es] INFO: Saving data for 1981340: {'created_time': 1774377162.576995, 'last_price_update_time': 1774377162.577007, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981340') HTTP/1.1" 204 0
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0ef6490>
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e903ed3f-331b-57c5-a9c9-ed79ecf51b89/e903ed3f-331b-57c5-a9c9-ed79ecf51b89_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252Fc62340bc1581499a943e7beca4e6f390%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/c62340bc1581499a943e7beca4e6f390/images/large/1.jpg saved to cache
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e903ed3f-331b-57c5-a9c9-ed79ecf51b89
2026-03-24 18:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e903ed3f-331b-57c5-a9c9-ed79ecf51b89, skipping ID generation
2026-03-24 18:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e903ed3f-331b-57c5-a9c9-ed79ecf51b89 with scrape type 1
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e903ed3f-331b-57c5-a9c9-ed79ecf51b89 sending to next pipeline
2026-03-24 18:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e903ed3f-331b-57c5-a9c9-ed79ecf51b89, identifier: 1981341
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1e4a50>
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca97f27-712f-5a0f-b8be-6b3bddef395c/bca97f27-712f-5a0f-b8be-6b3bddef395c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F90d5cc47b19a47f9b5b05e46df0bdd48%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/90d5cc47b19a47f9b5b05e46df0bdd48/images/large/1.jpg saved to cache
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bca97f27-712f-5a0f-b8be-6b3bddef395c
2026-03-24 18:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bca97f27-712f-5a0f-b8be-6b3bddef395c, skipping ID generation
2026-03-24 18:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca97f27-712f-5a0f-b8be-6b3bddef395c with scrape type 1
2026-03-24 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bca97f27-712f-5a0f-b8be-6b3bddef395c sending to next pipeline
2026-03-24 18:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bca97f27-712f-5a0f-b8be-6b3bddef395c, identifier: 1981344
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1fd9d0>
2026-03-24 18:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e8131d-eccb-5269-8874-ae528d74bfd8/d6e8131d-eccb-5269-8874-ae528d74bfd8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252F7fe3cfe3e40e45ce9ae9f0cff100b3d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/7fe3cfe3e40e45ce9ae9f0cff100b3d9/images/large/1.jpg saved to cache
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6e8131d-eccb-5269-8874-ae528d74bfd8
2026-03-24 18:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6e8131d-eccb-5269-8874-ae528d74bfd8, skipping ID generation
2026-03-24 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e8131d-eccb-5269-8874-ae528d74bfd8 with scrape type 1
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6e8131d-eccb-5269-8874-ae528d74bfd8 sending to next pipeline
2026-03-24 18:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6e8131d-eccb-5269-8874-ae528d74bfd8, identifier: 1981339
2026-03-24 18:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea3de90>
2026-03-24 18:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a733a1b7-0218-5a77-a44c-c379c8a2e93a/a733a1b7-0218-5a77-a44c-c379c8a2e93a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252Fe0b64ea2f9904470b79e3ec3256395be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/e0b64ea2f9904470b79e3ec3256395be/images/large/1.jpg saved to cache
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a733a1b7-0218-5a77-a44c-c379c8a2e93a
2026-03-24 18:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a733a1b7-0218-5a77-a44c-c379c8a2e93a, skipping ID generation
2026-03-24 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a733a1b7-0218-5a77-a44c-c379c8a2e93a with scrape type 1
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a733a1b7-0218-5a77-a44c-c379c8a2e93a sending to next pipeline
2026-03-24 18:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a733a1b7-0218-5a77-a44c-c379c8a2e93a, identifier: 1981342
2026-03-24 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/396/a42766a9784144b7946d585c54ffa74f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:43 [ayvens.es] INFO: Found listing with ID: 1981354
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981354%27 HTTP/1.1" 200 None
2026-03-24 18:32:43 [ayvens.es] INFO: Scrape type for 1981354: 1
2026-03-24 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1981354
2026-03-24 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1981354
2026-03-24 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with scrape type 1
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F19229d82f49f4fceab153e3953f0236a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/19229d82f49f4fceab153e3953f0236a/images/large/1.jpg not downloaded yet
2026-03-24 18:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e903ed3f-331b-57c5-a9c9-ed79ecf51b89 with identifier: 1981341
2026-03-24 18:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e903ed3f-331b-57c5-a9c9-ed79ecf51b89 with identifier: 1981341
2026-03-24 18:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e903ed3f-331b-57c5-a9c9-ed79ecf51b89 with identifier: 1981341 to the API
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/774/c62340bc1581499a943e7beca4e6f390/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e903ed3f-331b-57c5-a9c9-ed79ecf51b89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 40117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e903ed3f-331b-57c5-a9c9-ed79ecf51b89/e903ed3f-331b-57c5-a9c9-ed79ecf51b89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/774/c62340bc1581499a943e7beca4e6f390/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981341%27 HTTP/1.1" 200 None
2026-03-24 18:32:43 [ayvens.es] INFO: Saving data for 1981341: {'created_time': 1774377163.625884, 'last_price_update_time': 1774377163.625898, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981341') HTTP/1.1" 204 0
2026-03-24 18:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1981344
2026-03-24 18:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1981344
2026-03-24 18:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1981344 to the API
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/90d5cc47b19a47f9b5b05e46df0bdd48/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bca97f27-712f-5a0f-b8be-6b3bddef395c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 110696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca97f27-712f-5a0f-b8be-6b3bddef395c/bca97f27-712f-5a0f-b8be-6b3bddef395c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/90d5cc47b19a47f9b5b05e46df0bdd48/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981344%27 HTTP/1.1" 200 None
2026-03-24 18:32:43 [ayvens.es] INFO: Saving data for 1981344: {'created_time': 1774377163.914026, 'last_price_update_time': 1774377163.914035, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981344') HTTP/1.1" 204 0
2026-03-24 18:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1981339
2026-03-24 18:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1981339
2026-03-24 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1981339 to the API
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/924/7fe3cfe3e40e45ce9ae9f0cff100b3d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd6e8131d-eccb-5269-8874-ae528d74bfd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 242187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e8131d-eccb-5269-8874-ae528d74bfd8/d6e8131d-eccb-5269-8874-ae528d74bfd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/924/7fe3cfe3e40e45ce9ae9f0cff100b3d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 GDi 97kW (132CV) Concept 4x2',
 'transmission': 'manual',
 'trim': '1.6 GDi 97kW (132CV) Concept 4x2',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981339%27 HTTP/1.1" 200 None
2026-03-24 18:32:44 [ayvens.es] INFO: Saving data for 1981339: {'created_time': 1774377164.185691, 'last_price_update_time': 1774377164.185701, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981339') HTTP/1.1" 204 0
2026-03-24 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a733a1b7-0218-5a77-a44c-c379c8a2e93a with identifier: 1981342
2026-03-24 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a733a1b7-0218-5a77-a44c-c379c8a2e93a with identifier: 1981342
2026-03-24 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a733a1b7-0218-5a77-a44c-c379c8a2e93a with identifier: 1981342 to the API
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/316/e0b64ea2f9904470b79e3ec3256395be/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Azul cavansita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a733a1b7-0218-5a77-a44c-c379c8a2e93a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 151161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a733a1b7-0218-5a77-a44c-c379c8a2e93a/a733a1b7-0218-5a77-a44c-c379c8a2e93a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/316/e0b64ea2f9904470b79e3ec3256395be/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 250 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 250 4MATIC',
 'vin': None,
 'year': 2017}
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981342%27 HTTP/1.1" 200 None
2026-03-24 18:32:44 [ayvens.es] INFO: Saving data for 1981342: {'created_time': 1774377164.57737, 'last_price_update_time': 1774377164.57738, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981342') HTTP/1.1" 204 0
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea3d7d0>
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7f2c2-0a12-588a-9831-6b38333f38c7/7ee7f2c2-0a12-588a-9831-6b38333f38c7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F658%252Fab42cf67e83e44a1bca5514c155df412%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/658/ab42cf67e83e44a1bca5514c155df412/images/large/1.jpg saved to cache
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7
2026-03-24 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ee7f2c2-0a12-588a-9831-6b38333f38c7, skipping ID generation
2026-03-24 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with scrape type 1
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7 sending to next pipeline
2026-03-24 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ee7f2c2-0a12-588a-9831-6b38333f38c7, identifier: 1981343
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb91190>
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29242d21-ada0-56e9-bf11-c96cc899b08a/29242d21-ada0-56e9-bf11-c96cc899b08a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F121%252Fdd28d8a660c147e79d42d9dc4b03962f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/121/dd28d8a660c147e79d42d9dc4b03962f/images/large/1.jpg saved to cache
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29242d21-ada0-56e9-bf11-c96cc899b08a
2026-03-24 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29242d21-ada0-56e9-bf11-c96cc899b08a, skipping ID generation
2026-03-24 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29242d21-ada0-56e9-bf11-c96cc899b08a with scrape type 1
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29242d21-ada0-56e9-bf11-c96cc899b08a sending to next pipeline
2026-03-24 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29242d21-ada0-56e9-bf11-c96cc899b08a, identifier: 1981345
2026-03-24 18:32:44 [ayvens.es] INFO: Found listing with ID: 1981355
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981355%27 HTTP/1.1" 200 None
2026-03-24 18:32:44 [ayvens.es] INFO: Scrape type for 1981355: 1
2026-03-24 18:32:44 [ayvens.es] INFO: Extracting data for car ID: 1981355
2026-03-24 18:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53241214-2592-5259-bd9c-9efe017483da with identifier: 1981355
2026-03-24 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53241214-2592-5259-bd9c-9efe017483da with scrape type 1
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 53241214-2592-5259-bd9c-9efe017483da
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F248%252F585504c6255047ac9b55758793b101db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/248/585504c6255047ac9b55758793b101db/images/large/1.jpg not downloaded yet
2026-03-24 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1981343
2026-03-24 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1981343
2026-03-24 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1981343 to the API
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/658/ab42cf67e83e44a1bca5514c155df412/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Azul luz de luna',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ee7f2c2-0a12-588a-9831-6b38333f38c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 71925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7f2c2-0a12-588a-9831-6b38333f38c7/7ee7f2c2-0a12-588a-9831-6b38333f38c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/658/ab42cf67e83e44a1bca5514c155df412/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Design 40 TDI 140kW quattro S tronic',
 'transmission': 'manual',
 'trim': 'Design 40 TDI 140kW quattro S tronic',
 'vin': None,
 'year': 2019}
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981343%27 HTTP/1.1" 200 None
2026-03-24 18:32:45 [ayvens.es] INFO: Saving data for 1981343: {'created_time': 1774377165.306565, 'last_price_update_time': 1774377165.306574, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981343') HTTP/1.1" 204 0
2026-03-24 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1981345
2026-03-24 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1981345
2026-03-24 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1981345 to the API
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/121/dd28d8a660c147e79d42d9dc4b03962f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '29242d21-ada0-56e9-bf11-c96cc899b08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 84836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29242d21-ada0-56e9-bf11-c96cc899b08a/29242d21-ada0-56e9-bf11-c96cc899b08a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/121/dd28d8a660c147e79d42d9dc4b03962f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981345%27 HTTP/1.1" 200 None
2026-03-24 18:32:45 [ayvens.es] INFO: Saving data for 1981345: {'created_time': 1774377165.619342, 'last_price_update_time': 1774377165.619353, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981345') HTTP/1.1" 204 0
2026-03-24 18:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee838d0>
2026-03-24 18:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1166059d-a88e-5611-aa35-76240059ebb4/1166059d-a88e-5611-aa35-76240059ebb4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F396%252Fa42766a9784144b7946d585c54ffa74f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/396/a42766a9784144b7946d585c54ffa74f/images/large/1.jpg saved to cache
2026-03-24 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1166059d-a88e-5611-aa35-76240059ebb4
2026-03-24 18:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1166059d-a88e-5611-aa35-76240059ebb4, skipping ID generation
2026-03-24 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1166059d-a88e-5611-aa35-76240059ebb4 with scrape type 1
2026-03-24 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1166059d-a88e-5611-aa35-76240059ebb4 sending to next pipeline
2026-03-24 18:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1166059d-a88e-5611-aa35-76240059ebb4, identifier: 1981346
2026-03-24 18:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/008/a0bea85657ef4a07b29d7001c7845353/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/724/cf026fdd71ef4596b0442a67eb1e76a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:45 [ayvens.es] INFO: Found listing with ID: 1981356
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981356%27 HTTP/1.1" 200 None
2026-03-24 18:32:45 [ayvens.es] INFO: Scrape type for 1981356: 1
2026-03-24 18:32:45 [ayvens.es] INFO: Extracting data for car ID: 1981356
2026-03-24 18:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a with identifier: 1981356
2026-03-24 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a with scrape type 1
2026-03-24 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F233%252Ff03c08ee3d2b4234877992e996fae8c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/233/f03c08ee3d2b4234877992e996fae8c4/images/large/1.jpg not downloaded yet
2026-03-24 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1166059d-a88e-5611-aa35-76240059ebb4 with identifier: 1981346
2026-03-24 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1166059d-a88e-5611-aa35-76240059ebb4 with identifier: 1981346
2026-03-24 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1166059d-a88e-5611-aa35-76240059ebb4 with identifier: 1981346 to the API
2026-03-24 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/396/a42766a9784144b7946d585c54ffa74f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Negro noche',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1166059d-a88e-5611-aa35-76240059ebb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 172802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1166059d-a88e-5611-aa35-76240059ebb4/1166059d-a88e-5611-aa35-76240059ebb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/396/a42766a9784144b7946d585c54ffa74f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 200 d',
 'transmission': 'manual',
 'trim': 'A 200 d',
 'vin': None,
 'year': 2019}
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981346%27 HTTP/1.1" 200 None
2026-03-24 18:32:46 [ayvens.es] INFO: Saving data for 1981346: {'created_time': 1774377166.122167, 'last_price_update_time': 1774377166.122177, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981346') HTTP/1.1" 204 0
2026-03-24 18:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/084/a3a505b16b854a189631349946b9cfb2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/728/555b5c6653964dcdbcca5c2663c7b097/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/941/4f2c7491db1341a7bc6a074d2448899f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:46 [ayvens.es] INFO: Found listing with ID: 1981357
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981357%27 HTTP/1.1" 200 None
2026-03-24 18:32:46 [ayvens.es] INFO: Scrape type for 1981357: 1
2026-03-24 18:32:46 [ayvens.es] INFO: Extracting data for car ID: 1981357
2026-03-24 18:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2fe3d7-493b-525b-a07c-f032335f43eb with identifier: 1981357
2026-03-24 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2fe3d7-493b-525b-a07c-f032335f43eb with scrape type 1
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce2fe3d7-493b-525b-a07c-f032335f43eb
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Fd266251d7b3541798d5a398c5eacc9fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/d266251d7b3541798d5a398c5eacc9fe/images/large/1.jpg not downloaded yet
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea66350>
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_885908a6-87d8-5cda-a4e2-d3fcc94281e5/885908a6-87d8-5cda-a4e2-d3fcc94281e5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252Fa0bea85657ef4a07b29d7001c7845353%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/a0bea85657ef4a07b29d7001c7845353/images/large/1.jpg saved to cache
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5
2026-03-24 18:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 885908a6-87d8-5cda-a4e2-d3fcc94281e5, skipping ID generation
2026-03-24 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with scrape type 1
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5 sending to next pipeline
2026-03-24 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 885908a6-87d8-5cda-a4e2-d3fcc94281e5, identifier: 1981349
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08ec0d0>
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583bd61d-901b-5542-b9b5-d1343114f8ab/583bd61d-901b-5542-b9b5-d1343114f8ab_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252Fcf026fdd71ef4596b0442a67eb1e76a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/cf026fdd71ef4596b0442a67eb1e76a4/images/large/1.jpg saved to cache
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 583bd61d-901b-5542-b9b5-d1343114f8ab
2026-03-24 18:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 583bd61d-901b-5542-b9b5-d1343114f8ab, skipping ID generation
2026-03-24 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 583bd61d-901b-5542-b9b5-d1343114f8ab with scrape type 1
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 583bd61d-901b-5542-b9b5-d1343114f8ab sending to next pipeline
2026-03-24 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 583bd61d-901b-5542-b9b5-d1343114f8ab, identifier: 1981347
2026-03-24 18:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/595/e35324ffd5124dbeaa66b41afa4de168/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:46 [ayvens.es] INFO: Found listing with ID: 1981358
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981358%27 HTTP/1.1" 200 None
2026-03-24 18:32:46 [ayvens.es] INFO: Scrape type for 1981358: 1
2026-03-24 18:32:46 [ayvens.es] INFO: Extracting data for car ID: 1981358
2026-03-24 18:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1981358
2026-03-24 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with scrape type 1
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252F75f73574ae0c4ca989174e09f9d0e052%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/75f73574ae0c4ca989174e09f9d0e052/images/large/1.jpg not downloaded yet
2026-03-24 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1981349
2026-03-24 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1981349
2026-03-24 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1981349 to the API
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/008/a0bea85657ef4a07b29d7001c7845353/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Phytonicblau metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '885908a6-87d8-5cda-a4e2-d3fcc94281e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2 GRAN TOURER',
 'odometer': 205944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885908a6-87d8-5cda-a4e2-d3fcc94281e5/885908a6-87d8-5cda-a4e2-d3fcc94281e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/008/a0bea85657ef4a07b29d7001c7845353/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 GRAN TOURER 218d',
 'transmission': 'manual',
 'trim': '218d',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981349%27 HTTP/1.1" 200 None
2026-03-24 18:32:46 [ayvens.es] INFO: Saving data for 1981349: {'created_time': 1774377166.857072, 'last_price_update_time': 1774377166.857082, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981349') HTTP/1.1" 204 0
2026-03-24 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 583bd61d-901b-5542-b9b5-d1343114f8ab with identifier: 1981347
2026-03-24 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 583bd61d-901b-5542-b9b5-d1343114f8ab with identifier: 1981347
2026-03-24 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 583bd61d-901b-5542-b9b5-d1343114f8ab with identifier: 1981347 to the API
2026-03-24 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/724/cf026fdd71ef4596b0442a67eb1e76a4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Carpathian grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '583bd61d-901b-5542-b9b5-d1343114f8ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR',
 'odometer': 43504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583bd61d-901b-5542-b9b5-d1343114f8ab/583bd61d-901b-5542-b9b5-d1343114f8ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/724/cf026fdd71ef4596b0442a67eb1e76a4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER VELAR 2.0 D180 132kW (180CV) S 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0 D180 132kW (180CV) S 4WD Auto',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981347%27 HTTP/1.1" 200 None
2026-03-24 18:32:47 [ayvens.es] INFO: Saving data for 1981347: {'created_time': 1774377167.153135, 'last_price_update_time': 1774377167.153146, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981347') HTTP/1.1" 204 0
2026-03-24 18:32:47 [ayvens.es] INFO: Found listing with ID: 1981359
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981359%27 HTTP/1.1" 200 None
2026-03-24 18:32:47 [ayvens.es] INFO: Scrape type for 1981359: 1
2026-03-24 18:32:47 [ayvens.es] INFO: Extracting data for car ID: 1981359
2026-03-24 18:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994b143c-93f6-5c36-846b-2785bef2b2e4 with identifier: 1981359
2026-03-24 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994b143c-93f6-5c36-846b-2785bef2b2e4 with scrape type 1
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 994b143c-93f6-5c36-846b-2785bef2b2e4
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F926%252Fac4e7126e74e47f7b50198ca6c94f49c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/926/ac4e7126e74e47f7b50198ca6c94f49c/images/large/1.jpg not downloaded yet
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed45850>
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612c972f-89f0-5e93-80d8-77912a342d36/612c972f-89f0-5e93-80d8-77912a342d36_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F084%252Fa3a505b16b854a189631349946b9cfb2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/084/a3a505b16b854a189631349946b9cfb2/images/large/1.jpg saved to cache
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 612c972f-89f0-5e93-80d8-77912a342d36
2026-03-24 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 612c972f-89f0-5e93-80d8-77912a342d36, skipping ID generation
2026-03-24 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612c972f-89f0-5e93-80d8-77912a342d36 with scrape type 1
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 612c972f-89f0-5e93-80d8-77912a342d36 sending to next pipeline
2026-03-24 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 612c972f-89f0-5e93-80d8-77912a342d36, identifier: 1981350
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee258e10>
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75265a9-305c-5c84-bf41-4fbfce833b43/d75265a9-305c-5c84-bf41-4fbfce833b43_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F728%252F555b5c6653964dcdbcca5c2663c7b097%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/728/555b5c6653964dcdbcca5c2663c7b097/images/large/1.jpg saved to cache
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d75265a9-305c-5c84-bf41-4fbfce833b43
2026-03-24 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d75265a9-305c-5c84-bf41-4fbfce833b43, skipping ID generation
2026-03-24 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75265a9-305c-5c84-bf41-4fbfce833b43 with scrape type 1
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d75265a9-305c-5c84-bf41-4fbfce833b43 sending to next pipeline
2026-03-24 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d75265a9-305c-5c84-bf41-4fbfce833b43, identifier: 1981351
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8d3bd0>
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f410f-3080-5ff0-90f8-7decd650d0e3/a90f410f-3080-5ff0-90f8-7decd650d0e3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F941%252F4f2c7491db1341a7bc6a074d2448899f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/941/4f2c7491db1341a7bc6a074d2448899f/images/large/1.jpg saved to cache
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a90f410f-3080-5ff0-90f8-7decd650d0e3
2026-03-24 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a90f410f-3080-5ff0-90f8-7decd650d0e3, skipping ID generation
2026-03-24 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90f410f-3080-5ff0-90f8-7decd650d0e3 with scrape type 1
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a90f410f-3080-5ff0-90f8-7decd650d0e3 sending to next pipeline
2026-03-24 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a90f410f-3080-5ff0-90f8-7decd650d0e3, identifier: 1981348
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6c7610>
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140b7b10-5cef-5137-a710-a45963521a81/140b7b10-5cef-5137-a710-a45963521a81_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Fe35324ffd5124dbeaa66b41afa4de168%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/e35324ffd5124dbeaa66b41afa4de168/images/large/1.jpg saved to cache
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 140b7b10-5cef-5137-a710-a45963521a81
2026-03-24 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 140b7b10-5cef-5137-a710-a45963521a81, skipping ID generation
2026-03-24 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 140b7b10-5cef-5137-a710-a45963521a81 with scrape type 1
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 140b7b10-5cef-5137-a710-a45963521a81 sending to next pipeline
2026-03-24 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 140b7b10-5cef-5137-a710-a45963521a81, identifier: 1981352
2026-03-24 18:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/197/9cce480cff5c482a88b4830db14b1215/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:47 [ayvens.es] INFO: Found listing with ID: 1981360
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981360%27 HTTP/1.1" 200 None
2026-03-24 18:32:47 [ayvens.es] INFO: Scrape type for 1981360: 1
2026-03-24 18:32:47 [ayvens.es] INFO: Extracting data for car ID: 1981360
2026-03-24 18:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1981360
2026-03-24 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f2e172-bc10-5879-8808-3c608062d020 with scrape type 1
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 91f2e172-bc10-5879-8808-3c608062d020
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fb39a956ec8234f629957cefbaec0419d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/b39a956ec8234f629957cefbaec0419d/images/large/1.jpg not downloaded yet
2026-03-24 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1981350
2026-03-24 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1981350
2026-03-24 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1981350 to the API
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/084/a3a505b16b854a189631349946b9cfb2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '612c972f-89f0-5e93-80d8-77912a342d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 89936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612c972f-89f0-5e93-80d8-77912a342d36/612c972f-89f0-5e93-80d8-77912a342d36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/084/a3a505b16b854a189631349946b9cfb2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel Pack',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981350%27 HTTP/1.1" 200 None
2026-03-24 18:32:48 [ayvens.es] INFO: Saving data for 1981350: {'created_time': 1774377168.252283, 'last_price_update_time': 1774377168.252293, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981350') HTTP/1.1" 204 0
2026-03-24 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1981351
2026-03-24 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1981351
2026-03-24 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1981351 to the API
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/728/555b5c6653964dcdbcca5c2663c7b097/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd75265a9-305c-5c84-bf41-4fbfce833b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'GRAND C-MAX',
 'odometer': 138918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75265a9-305c-5c84-bf41-4fbfce833b43/d75265a9-305c-5c84-bf41-4fbfce833b43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/728/555b5c6653964dcdbcca5c2663c7b097/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD GRAND C-MAX 1.5 TDCi 88kW (120CV) Business',
 'transmission': 'manual',
 'trim': '1.5 TDCi 88kW (120CV) Business',
 'vin': None,
 'year': 2019}
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981351%27 HTTP/1.1" 200 None
2026-03-24 18:32:48 [ayvens.es] INFO: Saving data for 1981351: {'created_time': 1774377168.548554, 'last_price_update_time': 1774377168.548565, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981351') HTTP/1.1" 204 0
2026-03-24 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1981348
2026-03-24 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1981348
2026-03-24 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1981348 to the API
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/941/4f2c7491db1341a7bc6a074d2448899f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Clear white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a90f410f-3080-5ff0-90f8-7decd650d0e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 135392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f410f-3080-5ff0-90f8-7decd650d0e3/a90f410f-3080-5ff0-90f8-7decd650d0e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/941/4f2c7491db1341a7bc6a074d2448899f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDi HEV 104kW (141CV) Drive+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '1.6 GDi HEV 104kW (141CV) Drive+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981348%27 HTTP/1.1" 200 None
2026-03-24 18:32:48 [ayvens.es] INFO: Saving data for 1981348: {'created_time': 1774377168.953991, 'last_price_update_time': 1774377168.954003, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981348') HTTP/1.1" 204 0
2026-03-24 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1981352
2026-03-24 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1981352
2026-03-24 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1981352 to the API
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/595/e35324ffd5124dbeaa66b41afa4de168/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Negro noche est',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '140b7b10-5cef-5137-a710-a45963521a81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 83638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_140b7b10-5cef-5137-a710-a45963521a81/140b7b10-5cef-5137-a710-a45963521a81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/595/e35324ffd5124dbeaa66b41afa4de168/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS Sedan A 180 d',
 'transmission': 'manual',
 'trim': 'Sedan A 180 d',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981352%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [ayvens.es] INFO: Saving data for 1981352: {'created_time': 1774377169.28036, 'last_price_update_time': 1774377169.280369, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981352') HTTP/1.1" 204 0
2026-03-24 18:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/19229d82f49f4fceab153e3953f0236a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/248/585504c6255047ac9b55758793b101db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:49 [ayvens.es] INFO: Found listing with ID: 1981361
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981361%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [ayvens.es] INFO: Scrape type for 1981361: 1
2026-03-24 18:32:49 [ayvens.es] INFO: Extracting data for car ID: 1981361
2026-03-24 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee with identifier: 1981361
2026-03-24 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee with scrape type 1
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F22ae4ee2deb24a9f86250539b2be6224%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/22ae4ee2deb24a9f86250539b2be6224/images/large/1.jpg not downloaded yet
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6dfd10>
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680c2be6-3c45-5f5a-b1ef-51e7b4dece25/680c2be6-3c45-5f5a-b1ef-51e7b4dece25_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F197%252F9cce480cff5c482a88b4830db14b1215%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/197/9cce480cff5c482a88b4830db14b1215/images/large/1.jpg saved to cache
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 680c2be6-3c45-5f5a-b1ef-51e7b4dece25
2026-03-24 18:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 680c2be6-3c45-5f5a-b1ef-51e7b4dece25, skipping ID generation
2026-03-24 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680c2be6-3c45-5f5a-b1ef-51e7b4dece25 with scrape type 1
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 680c2be6-3c45-5f5a-b1ef-51e7b4dece25 sending to next pipeline
2026-03-24 18:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 680c2be6-3c45-5f5a-b1ef-51e7b4dece25, identifier: 1981353
2026-03-24 18:32:49 [ayvens.es] INFO: Found listing with ID: 1981362
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981362%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [ayvens.es] INFO: Scrape type for 1981362: 1
2026-03-24 18:32:49 [ayvens.es] INFO: Extracting data for car ID: 1981362
2026-03-24 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1981362
2026-03-24 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with scrape type 1
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252F8eae5f719f0248e9b3ff8a118e084feb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/8eae5f719f0248e9b3ff8a118e084feb/images/large/1.jpg not downloaded yet
2026-03-24 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 680c2be6-3c45-5f5a-b1ef-51e7b4dece25 with identifier: 1981353
2026-03-24 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 680c2be6-3c45-5f5a-b1ef-51e7b4dece25 with identifier: 1981353
2026-03-24 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 680c2be6-3c45-5f5a-b1ef-51e7b4dece25 with identifier: 1981353 to the API
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/197/9cce480cff5c482a88b4830db14b1215/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Azul denim',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '680c2be6-3c45-5f5a-b1ef-51e7b4dece25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 131722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680c2be6-3c45-5f5a-b1ef-51e7b4dece25/680c2be6-3c45-5f5a-b1ef-51e7b4dece25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/197/9cce480cff5c482a88b4830db14b1215/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981353%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [ayvens.es] INFO: Saving data for 1981353: {'created_time': 1774377169.860252, 'last_price_update_time': 1774377169.860265, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981353') HTTP/1.1" 204 0
2026-03-24 18:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/378/d266251d7b3541798d5a398c5eacc9fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/233/f03c08ee3d2b4234877992e996fae8c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:49 [ayvens.es] INFO: Found listing with ID: 1981363
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981363%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [ayvens.es] INFO: Scrape type for 1981363: 1
2026-03-24 18:32:49 [ayvens.es] INFO: Extracting data for car ID: 1981363
2026-03-24 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d910cb-6ee8-5108-af04-12e834bb5730 with identifier: 1981363
2026-03-24 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d910cb-6ee8-5108-af04-12e834bb5730 with scrape type 1
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a7d910cb-6ee8-5108-af04-12e834bb5730
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F005%252F4da7e5ef6d0a44af883358b39e214c06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/005/4da7e5ef6d0a44af883358b39e214c06/images/large/1.jpg not downloaded yet
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05f6f50>
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b01c6d1-3da4-504b-ba36-8dc3443fc416/7b01c6d1-3da4-504b-ba36-8dc3443fc416_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F19229d82f49f4fceab153e3953f0236a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/19229d82f49f4fceab153e3953f0236a/images/large/1.jpg saved to cache
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416
2026-03-24 18:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b01c6d1-3da4-504b-ba36-8dc3443fc416, skipping ID generation
2026-03-24 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with scrape type 1
2026-03-24 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416 sending to next pipeline
2026-03-24 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7b01c6d1-3da4-504b-ba36-8dc3443fc416, identifier: 1981354
2026-03-24 18:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08ef7d0>
2026-03-24 18:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53241214-2592-5259-bd9c-9efe017483da/53241214-2592-5259-bd9c-9efe017483da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F248%252F585504c6255047ac9b55758793b101db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/248/585504c6255047ac9b55758793b101db/images/large/1.jpg saved to cache
2026-03-24 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53241214-2592-5259-bd9c-9efe017483da
2026-03-24 18:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53241214-2592-5259-bd9c-9efe017483da, skipping ID generation
2026-03-24 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53241214-2592-5259-bd9c-9efe017483da with scrape type 1
2026-03-24 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53241214-2592-5259-bd9c-9efe017483da sending to next pipeline
2026-03-24 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 53241214-2592-5259-bd9c-9efe017483da, identifier: 1981355
2026-03-24 18:32:50 [ayvens.es] INFO: Found listing with ID: 1981364
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981364%27 HTTP/1.1" 200 None
2026-03-24 18:32:50 [ayvens.es] INFO: Scrape type for 1981364: 1
2026-03-24 18:32:50 [ayvens.es] INFO: Extracting data for car ID: 1981364
2026-03-24 18:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1981364
2026-03-24 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with scrape type 1
2026-03-24 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F454%252Ff9031bf4f9df40daa2961e97fd883c57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/454/f9031bf4f9df40daa2961e97fd883c57/images/large/1.jpg not downloaded yet
2026-03-24 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1981354
2026-03-24 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1981354
2026-03-24 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1981354 to the API
2026-03-24 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/635/19229d82f49f4fceab153e3953f0236a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata perla moondust',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7b01c6d1-3da4-504b-ba36-8dc3443fc416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 56848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b01c6d1-3da4-504b-ba36-8dc3443fc416/7b01c6d1-3da4-504b-ba36-8dc3443fc416_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/19229d82f49f4fceab153e3953f0236a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981354%27 HTTP/1.1" 200 None
2026-03-24 18:32:51 [ayvens.es] INFO: Saving data for 1981354: {'created_time': 1774377171.627189, 'last_price_update_time': 1774377171.6272, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981354') HTTP/1.1" 204 0
2026-03-24 18:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 53241214-2592-5259-bd9c-9efe017483da with identifier: 1981355
2026-03-24 18:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 53241214-2592-5259-bd9c-9efe017483da with identifier: 1981355
2026-03-24 18:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 53241214-2592-5259-bd9c-9efe017483da with identifier: 1981355 to the API
2026-03-24 18:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/248/585504c6255047ac9b55758793b101db/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '53241214-2592-5259-bd9c-9efe017483da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 184246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53241214-2592-5259-bd9c-9efe017483da/53241214-2592-5259-bd9c-9efe017483da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/248/585504c6255047ac9b55758793b101db/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981355%27 HTTP/1.1" 200 None
2026-03-24 18:32:52 [ayvens.es] INFO: Saving data for 1981355: {'created_time': 1774377172.422095, 'last_price_update_time': 1774377172.422104, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981355') HTTP/1.1" 204 0
2026-03-24 18:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/763/75f73574ae0c4ca989174e09f9d0e052/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/926/ac4e7126e74e47f7b50198ca6c94f49c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:52 [ayvens.es] INFO: Found listing with ID: 1981365
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981365%27 HTTP/1.1" 200 None
2026-03-24 18:32:52 [ayvens.es] INFO: Scrape type for 1981365: 1
2026-03-24 18:32:52 [ayvens.es] INFO: Extracting data for car ID: 1981365
2026-03-24 18:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1981365
2026-03-24 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bf4122-0506-5842-a316-f78e6a35452f with scrape type 1
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4bf4122-0506-5842-a316-f78e6a35452f
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F289d51a9b628407cbd06dd97bd5c546c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/289d51a9b628407cbd06dd97bd5c546c/images/large/1.jpg not downloaded yet
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05ecb90>
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce2fe3d7-493b-525b-a07c-f032335f43eb/ce2fe3d7-493b-525b-a07c-f032335f43eb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Fd266251d7b3541798d5a398c5eacc9fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/d266251d7b3541798d5a398c5eacc9fe/images/large/1.jpg saved to cache
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce2fe3d7-493b-525b-a07c-f032335f43eb
2026-03-24 18:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce2fe3d7-493b-525b-a07c-f032335f43eb, skipping ID generation
2026-03-24 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2fe3d7-493b-525b-a07c-f032335f43eb with scrape type 1
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce2fe3d7-493b-525b-a07c-f032335f43eb sending to next pipeline
2026-03-24 18:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce2fe3d7-493b-525b-a07c-f032335f43eb, identifier: 1981357
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9589d0>
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a/dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F233%252Ff03c08ee3d2b4234877992e996fae8c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/233/f03c08ee3d2b4234877992e996fae8c4/images/large/1.jpg saved to cache
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a
2026-03-24 18:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a, skipping ID generation
2026-03-24 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a with scrape type 1
2026-03-24 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a sending to next pipeline
2026-03-24 18:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a, identifier: 1981356
2026-03-24 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce2fe3d7-493b-525b-a07c-f032335f43eb with identifier: 1981357
2026-03-24 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce2fe3d7-493b-525b-a07c-f032335f43eb with identifier: 1981357
2026-03-24 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce2fe3d7-493b-525b-a07c-f032335f43eb with identifier: 1981357 to the API
2026-03-24 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/378/d266251d7b3541798d5a398c5eacc9fe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce2fe3d7-493b-525b-a07c-f032335f43eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 171900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2fe3d7-493b-525b-a07c-f032335f43eb/ce2fe3d7-493b-525b-a07c-f032335f43eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/378/d266251d7b3541798d5a398c5eacc9fe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 2.0 TDI 110kW (150 CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150 CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981357%27 HTTP/1.1" 200 None
2026-03-24 18:32:53 [ayvens.es] INFO: Saving data for 1981357: {'created_time': 1774377173.313048, 'last_price_update_time': 1774377173.313059, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981357') HTTP/1.1" 204 0
2026-03-24 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a with identifier: 1981356
2026-03-24 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a with identifier: 1981356
2026-03-24 18:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a with identifier: 1981356 to the API
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/233/f03c08ee3d2b4234877992e996fae8c4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 107004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a/dbe0f25c-c0a0-5fb2-90e1-98ec128a6a4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/233/f03c08ee3d2b4234877992e996fae8c4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981356%27 HTTP/1.1" 200 None
2026-03-24 18:32:53 [ayvens.es] INFO: Saving data for 1981356: {'created_time': 1774377173.619183, 'last_price_update_time': 1774377173.619193, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981356') HTTP/1.1" 204 0
2026-03-24 18:32:53 [ayvens.es] INFO: Found listing with ID: 1981366
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981366%27 HTTP/1.1" 200 None
2026-03-24 18:32:53 [ayvens.es] INFO: Scrape type for 1981366: 1
2026-03-24 18:32:53 [ayvens.es] INFO: Extracting data for car ID: 1981366
2026-03-24 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1 with identifier: 1981366
2026-03-24 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1 with scrape type 1
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F436%252Fe70f443af6e34fb1afe755da59ab2b3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/436/e70f443af6e34fb1afe755da59ab2b3c/images/large/1.jpg not downloaded yet
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f26d0>
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941ee17-c97e-5a0b-adb2-f979c205a9b7/1941ee17-c97e-5a0b-adb2-f979c205a9b7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252F75f73574ae0c4ca989174e09f9d0e052%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/75f73574ae0c4ca989174e09f9d0e052/images/large/1.jpg saved to cache
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7
2026-03-24 18:32:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1941ee17-c97e-5a0b-adb2-f979c205a9b7, skipping ID generation
2026-03-24 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with scrape type 1
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7 sending to next pipeline
2026-03-24 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1941ee17-c97e-5a0b-adb2-f979c205a9b7, identifier: 1981358
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8c9090>
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994b143c-93f6-5c36-846b-2785bef2b2e4/994b143c-93f6-5c36-846b-2785bef2b2e4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F926%252Fac4e7126e74e47f7b50198ca6c94f49c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/926/ac4e7126e74e47f7b50198ca6c94f49c/images/large/1.jpg saved to cache
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 994b143c-93f6-5c36-846b-2785bef2b2e4
2026-03-24 18:32:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 994b143c-93f6-5c36-846b-2785bef2b2e4, skipping ID generation
2026-03-24 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994b143c-93f6-5c36-846b-2785bef2b2e4 with scrape type 1
2026-03-24 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 994b143c-93f6-5c36-846b-2785bef2b2e4 sending to next pipeline
2026-03-24 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 994b143c-93f6-5c36-846b-2785bef2b2e4, identifier: 1981359
2026-03-24 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/324/b39a956ec8234f629957cefbaec0419d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/531/22ae4ee2deb24a9f86250539b2be6224/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:54 [ayvens.es] INFO: Found listing with ID: 1981367
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981367%27 HTTP/1.1" 200 None
2026-03-24 18:32:54 [ayvens.es] INFO: Scrape type for 1981367: 1
2026-03-24 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1981367
2026-03-24 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb177f05-7557-586e-afa1-b883ae110eea with identifier: 1981367
2026-03-24 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb177f05-7557-586e-afa1-b883ae110eea with scrape type 1
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb177f05-7557-586e-afa1-b883ae110eea
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F873%252Fc2b8935fbb2b4175be4a81da23fbc598%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/873/c2b8935fbb2b4175be4a81da23fbc598/images/large/1.jpg not downloaded yet
2026-03-24 18:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1981358
2026-03-24 18:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1981358
2026-03-24 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1981358 to the API
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/763/75f73574ae0c4ca989174e09f9d0e052/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1941ee17-c97e-5a0b-adb2-f979c205a9b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 CACTUS',
 'odometer': 190185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941ee17-c97e-5a0b-adb2-f979c205a9b7/1941ee17-c97e-5a0b-adb2-f979c205a9b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/763/75f73574ae0c4ca989174e09f9d0e052/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 CACTUS (O) BlueHDi 100 S&S C-Series',
 'transmission': 'manual',
 'trim': '(O) BlueHDi 100 S&S C-Series',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981358%27 HTTP/1.1" 200 None
2026-03-24 18:32:54 [ayvens.es] INFO: Saving data for 1981358: {'created_time': 1774377174.329434, 'last_price_update_time': 1774377174.329443, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981358') HTTP/1.1" 204 0
2026-03-24 18:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 994b143c-93f6-5c36-846b-2785bef2b2e4 with identifier: 1981359
2026-03-24 18:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 994b143c-93f6-5c36-846b-2785bef2b2e4 with identifier: 1981359
2026-03-24 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 994b143c-93f6-5c36-846b-2785bef2b2e4 with identifier: 1981359 to the API
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/926/ac4e7126e74e47f7b50198ca6c94f49c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '994b143c-93f6-5c36-846b-2785bef2b2e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 57916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994b143c-93f6-5c36-846b-2785bef2b2e4/994b143c-93f6-5c36-846b-2785bef2b2e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/926/ac4e7126e74e47f7b50198ca6c94f49c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981359%27 HTTP/1.1" 200 None
2026-03-24 18:32:54 [ayvens.es] INFO: Saving data for 1981359: {'created_time': 1774377174.649671, 'last_price_update_time': 1774377174.649681, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981359') HTTP/1.1" 204 0
2026-03-24 18:32:54 [ayvens.es] INFO: Found listing with ID: 1981368
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981368%27 HTTP/1.1" 200 None
2026-03-24 18:32:54 [ayvens.es] INFO: Scrape type for 1981368: 1
2026-03-24 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1981368
2026-03-24 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1981368
2026-03-24 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f912415-ed86-5d07-a890-2ff4c10f8551 with scrape type 1
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f912415-ed86-5d07-a890-2ff4c10f8551
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F880%252Fe7151c9a912b41a5bc9249f6b1f4cca7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/880/e7151c9a912b41a5bc9249f6b1f4cca7/images/large/1.jpg not downloaded yet
2026-03-24 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/538/8eae5f719f0248e9b3ff8a118e084feb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/005/4da7e5ef6d0a44af883358b39e214c06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee905650>
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f2e172-bc10-5879-8808-3c608062d020/91f2e172-bc10-5879-8808-3c608062d020_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fb39a956ec8234f629957cefbaec0419d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/b39a956ec8234f629957cefbaec0419d/images/large/1.jpg saved to cache
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91f2e172-bc10-5879-8808-3c608062d020
2026-03-24 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91f2e172-bc10-5879-8808-3c608062d020, skipping ID generation
2026-03-24 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f2e172-bc10-5879-8808-3c608062d020 with scrape type 1
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91f2e172-bc10-5879-8808-3c608062d020 sending to next pipeline
2026-03-24 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 91f2e172-bc10-5879-8808-3c608062d020, identifier: 1981360
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1ff010>
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee/0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F22ae4ee2deb24a9f86250539b2be6224%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/22ae4ee2deb24a9f86250539b2be6224/images/large/1.jpg saved to cache
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee
2026-03-24 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee, skipping ID generation
2026-03-24 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee with scrape type 1
2026-03-24 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee sending to next pipeline
2026-03-24 18:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee, identifier: 1981361
2026-03-24 18:32:55 [ayvens.es] INFO: Found listing with ID: 1981369
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981369%27 HTTP/1.1" 200 None
2026-03-24 18:32:55 [ayvens.es] INFO: Scrape type for 1981369: 1
2026-03-24 18:32:55 [ayvens.es] INFO: Extracting data for car ID: 1981369
2026-03-24 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91bd3ca-1b9e-5f92-8b93-ffa8273261ef with identifier: 1981369
2026-03-24 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91bd3ca-1b9e-5f92-8b93-ffa8273261ef with scrape type 1
2026-03-24 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e91bd3ca-1b9e-5f92-8b93-ffa8273261ef
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F495038b48a4d49ae8f1e1f2c7ff1e47f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/495038b48a4d49ae8f1e1f2c7ff1e47f/images/large/1.jpg not downloaded yet
2026-03-24 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1981360
2026-03-24 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1981360
2026-03-24 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1981360 to the API
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/324/b39a956ec8234f629957cefbaec0419d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '91f2e172-bc10-5879-8808-3c608062d020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 162403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f2e172-bc10-5879-8808-3c608062d020/91f2e172-bc10-5879-8808-3c608062d020_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/b39a956ec8234f629957cefbaec0419d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981360%27 HTTP/1.1" 200 None
2026-03-24 18:32:55 [ayvens.es] INFO: Saving data for 1981360: {'created_time': 1774377175.38568, 'last_price_update_time': 1774377175.385693, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981360') HTTP/1.1" 204 0
2026-03-24 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee with identifier: 1981361
2026-03-24 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee with identifier: 1981361
2026-03-24 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee with identifier: 1981361 to the API
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/531/22ae4ee2deb24a9f86250539b2be6224/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata perla moondust',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 87942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee/0f1c166f-1916-5ee0-87c6-f4b93ce4b7ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/531/22ae4ee2deb24a9f86250539b2be6224/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981361%27 HTTP/1.1" 200 None
2026-03-24 18:32:55 [ayvens.es] INFO: Saving data for 1981361: {'created_time': 1774377175.678412, 'last_price_update_time': 1774377175.678421, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981361') HTTP/1.1" 204 0
2026-03-24 18:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/454/f9031bf4f9df40daa2961e97fd883c57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:55 [ayvens.es] INFO: Found listing with ID: 1981370
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981370%27 HTTP/1.1" 200 None
2026-03-24 18:32:55 [ayvens.es] INFO: Scrape type for 1981370: 1
2026-03-24 18:32:55 [ayvens.es] INFO: Extracting data for car ID: 1981370
2026-03-24 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1981370
2026-03-24 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b787f4c-6a63-509b-8d09-7cc4eb051806 with scrape type 1
2026-03-24 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4b787f4c-6a63-509b-8d09-7cc4eb051806
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F452%252Fdf9ce71ef52746b083fa672b8f4f8912%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/452/df9ce71ef52746b083fa672b8f4f8912/images/large/1.jpg not downloaded yet
2026-03-24 18:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/289d51a9b628407cbd06dd97bd5c546c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1d4190>
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43/2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252F8eae5f719f0248e9b3ff8a118e084feb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/8eae5f719f0248e9b3ff8a118e084feb/images/large/1.jpg saved to cache
2026-03-24 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43
2026-03-24 18:32:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43, skipping ID generation
2026-03-24 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with scrape type 1
2026-03-24 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 sending to next pipeline
2026-03-24 18:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43, identifier: 1981362
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6c4f10>
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d910cb-6ee8-5108-af04-12e834bb5730/a7d910cb-6ee8-5108-af04-12e834bb5730_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F005%252F4da7e5ef6d0a44af883358b39e214c06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/005/4da7e5ef6d0a44af883358b39e214c06/images/large/1.jpg saved to cache
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7d910cb-6ee8-5108-af04-12e834bb5730
2026-03-24 18:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7d910cb-6ee8-5108-af04-12e834bb5730, skipping ID generation
2026-03-24 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d910cb-6ee8-5108-af04-12e834bb5730 with scrape type 1
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7d910cb-6ee8-5108-af04-12e834bb5730 sending to next pipeline
2026-03-24 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a7d910cb-6ee8-5108-af04-12e834bb5730, identifier: 1981363
2026-03-24 18:32:56 [ayvens.es] INFO: Found listing with ID: 1981371
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981371%27 HTTP/1.1" 200 None
2026-03-24 18:32:56 [ayvens.es] INFO: Scrape type for 1981371: 1
2026-03-24 18:32:56 [ayvens.es] INFO: Extracting data for car ID: 1981371
2026-03-24 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e0d8d2-bc66-52c1-b918-f2796f37b63f with identifier: 1981371
2026-03-24 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e0d8d2-bc66-52c1-b918-f2796f37b63f with scrape type 1
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0e0d8d2-bc66-52c1-b918-f2796f37b63f
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F294%252F4336657284d24ee196db6ae532484cf6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/294/4336657284d24ee196db6ae532484cf6/images/large/1.jpg not downloaded yet
2026-03-24 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1981362
2026-03-24 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1981362
2026-03-24 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1981362 to the API
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/538/8eae5f719f0248e9b3ff8a118e084feb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 36212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43/2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/538/8eae5f719f0248e9b3ff8a118e084feb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2021}
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981362%27 HTTP/1.1" 200 None
2026-03-24 18:32:56 [ayvens.es] INFO: Saving data for 1981362: {'created_time': 1774377176.399508, 'last_price_update_time': 1774377176.399517, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981362') HTTP/1.1" 204 0
2026-03-24 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a7d910cb-6ee8-5108-af04-12e834bb5730 with identifier: 1981363
2026-03-24 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a7d910cb-6ee8-5108-af04-12e834bb5730 with identifier: 1981363
2026-03-24 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a7d910cb-6ee8-5108-af04-12e834bb5730 with identifier: 1981363 to the API
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/005/4da7e5ef6d0a44af883358b39e214c06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a7d910cb-6ee8-5108-af04-12e834bb5730',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'X-TRAIL',
 'odometer': 305808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d910cb-6ee8-5108-af04-12e834bb5730/a7d910cb-6ee8-5108-af04-12e834bb5730_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/005/4da7e5ef6d0a44af883358b39e214c06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN X-TRAIL 5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'transmission': 'manual',
 'trim': '5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981363%27 HTTP/1.1" 200 None
2026-03-24 18:32:56 [ayvens.es] INFO: Saving data for 1981363: {'created_time': 1774377176.709664, 'last_price_update_time': 1774377176.709675, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981363') HTTP/1.1" 204 0
2026-03-24 18:32:56 [ayvens.es] INFO: Found listing with ID: 1981372
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981372%27 HTTP/1.1" 200 None
2026-03-24 18:32:56 [ayvens.es] INFO: Scrape type for 1981372: 1
2026-03-24 18:32:56 [ayvens.es] INFO: Extracting data for car ID: 1981372
2026-03-24 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2381376-e33b-50bc-905b-7f65a48fd504 with identifier: 1981372
2026-03-24 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2381376-e33b-50bc-905b-7f65a48fd504 with scrape type 1
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2381376-e33b-50bc-905b-7f65a48fd504
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252F3d0f711034ea4ecf8f99dc9ef3e55507%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/3d0f711034ea4ecf8f99dc9ef3e55507/images/large/1.jpg not downloaded yet
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee21af50>
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3710ae9-96fe-5ba3-af82-b95cc677f3a1/e3710ae9-96fe-5ba3-af82-b95cc677f3a1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F454%252Ff9031bf4f9df40daa2961e97fd883c57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/454/f9031bf4f9df40daa2961e97fd883c57/images/large/1.jpg saved to cache
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1
2026-03-24 18:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3710ae9-96fe-5ba3-af82-b95cc677f3a1, skipping ID generation
2026-03-24 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with scrape type 1
2026-03-24 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1 sending to next pipeline
2026-03-24 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e3710ae9-96fe-5ba3-af82-b95cc677f3a1, identifier: 1981364
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05ef810>
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bf4122-0506-5842-a316-f78e6a35452f/b4bf4122-0506-5842-a316-f78e6a35452f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F289d51a9b628407cbd06dd97bd5c546c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/289d51a9b628407cbd06dd97bd5c546c/images/large/1.jpg saved to cache
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4bf4122-0506-5842-a316-f78e6a35452f
2026-03-24 18:32:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4bf4122-0506-5842-a316-f78e6a35452f, skipping ID generation
2026-03-24 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bf4122-0506-5842-a316-f78e6a35452f with scrape type 1
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4bf4122-0506-5842-a316-f78e6a35452f sending to next pipeline
2026-03-24 18:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4bf4122-0506-5842-a316-f78e6a35452f, identifier: 1981365
2026-03-24 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/436/e70f443af6e34fb1afe755da59ab2b3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:57 [ayvens.es] INFO: Found listing with ID: 1981373
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981373%27 HTTP/1.1" 200 None
2026-03-24 18:32:57 [ayvens.es] INFO: Scrape type for 1981373: 1
2026-03-24 18:32:57 [ayvens.es] INFO: Extracting data for car ID: 1981373
2026-03-24 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1981373
2026-03-24 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13130dfd-bbfd-52b9-a434-38e047dee08c with scrape type 1
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13130dfd-bbfd-52b9-a434-38e047dee08c
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252F363a9e4d221f4811adbd4ebefe00bbeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/363a9e4d221f4811adbd4ebefe00bbeb/images/large/1.jpg not downloaded yet
2026-03-24 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1981364
2026-03-24 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1981364
2026-03-24 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1981364 to the API
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/454/f9031bf4f9df40daa2961e97fd883c57/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e3710ae9-96fe-5ba3-af82-b95cc677f3a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'X-TRAIL',
 'odometer': 132716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3710ae9-96fe-5ba3-af82-b95cc677f3a1/e3710ae9-96fe-5ba3-af82-b95cc677f3a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/454/f9031bf4f9df40daa2961e97fd883c57/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN X-TRAIL 5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'transmission': 'manual',
 'trim': '5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981364%27 HTTP/1.1" 200 None
2026-03-24 18:32:57 [ayvens.es] INFO: Saving data for 1981364: {'created_time': 1774377177.51376, 'last_price_update_time': 1774377177.513771, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981364') HTTP/1.1" 204 0
2026-03-24 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1981365
2026-03-24 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1981365
2026-03-24 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1981365 to the API
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/034/289d51a9b628407cbd06dd97bd5c546c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b4bf4122-0506-5842-a316-f78e6a35452f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 42818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bf4122-0506-5842-a316-f78e6a35452f/b4bf4122-0506-5842-a316-f78e6a35452f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/289d51a9b628407cbd06dd97bd5c546c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981365%27 HTTP/1.1" 200 None
2026-03-24 18:32:57 [ayvens.es] INFO: Saving data for 1981365: {'created_time': 1774377177.803727, 'last_price_update_time': 1774377177.803737, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981365') HTTP/1.1" 204 0
2026-03-24 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/880/e7151c9a912b41a5bc9249f6b1f4cca7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:57 [ayvens.es] INFO: Found listing with ID: 1981374
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981374%27 HTTP/1.1" 200 None
2026-03-24 18:32:57 [ayvens.es] INFO: Scrape type for 1981374: 1
2026-03-24 18:32:57 [ayvens.es] INFO: Extracting data for car ID: 1981374
2026-03-24 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e with identifier: 1981374
2026-03-24 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e with scrape type 1
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F295%252F20e640e625894dafbddb4e50a719ffb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/295/20e640e625894dafbddb4e50a719ffb3/images/large/1.jpg not downloaded yet
2026-03-24 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/537/495038b48a4d49ae8f1e1f2c7ff1e47f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1e7e10>
2026-03-24 18:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1/401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F436%252Fe70f443af6e34fb1afe755da59ab2b3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/436/e70f443af6e34fb1afe755da59ab2b3c/images/large/1.jpg saved to cache
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1
2026-03-24 18:32:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1, skipping ID generation
2026-03-24 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1 with scrape type 1
2026-03-24 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1 sending to next pipeline
2026-03-24 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1, identifier: 1981366
2026-03-24 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/873/c2b8935fbb2b4175be4a81da23fbc598/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:58 [ayvens.es] INFO: Found listing with ID: 1981375
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981375%27 HTTP/1.1" 200 None
2026-03-24 18:32:58 [ayvens.es] INFO: Scrape type for 1981375: 1
2026-03-24 18:32:58 [ayvens.es] INFO: Extracting data for car ID: 1981375
2026-03-24 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8 with identifier: 1981375
2026-03-24 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8 with scrape type 1
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F101%252F472fdf980e1048eb9ebe983e1f0283ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/101/472fdf980e1048eb9ebe983e1f0283ce/images/large/1.jpg not downloaded yet
2026-03-24 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1 with identifier: 1981366
2026-03-24 18:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1 with identifier: 1981366
2026-03-24 18:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1 with identifier: 1981366 to the API
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/436/e70f443af6e34fb1afe755da59ab2b3c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 117390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1/401dca37-3f1d-5dce-a4b3-dd53aa6a5fe1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/436/e70f443af6e34fb1afe755da59ab2b3c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981366%27 HTTP/1.1" 200 None
2026-03-24 18:32:58 [ayvens.es] INFO: Saving data for 1981366: {'created_time': 1774377178.341036, 'last_price_update_time': 1774377178.341047, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981366') HTTP/1.1" 204 0
2026-03-24 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/452/df9ce71ef52746b083fa672b8f4f8912/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:58 [ayvens.es] INFO: Found listing with ID: 1981376
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981376%27 HTTP/1.1" 200 None
2026-03-24 18:32:58 [ayvens.es] INFO: Scrape type for 1981376: 1
2026-03-24 18:32:58 [ayvens.es] INFO: Extracting data for car ID: 1981376
2026-03-24 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1981376
2026-03-24 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447f9435-365a-5fbc-a299-9e91cab52b3b with scrape type 1
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 447f9435-365a-5fbc-a299-9e91cab52b3b
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fbac6d7fb2ff749fe851f94fa23481e5d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/bac6d7fb2ff749fe851f94fa23481e5d/images/large/1.jpg not downloaded yet
2026-03-24 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/294/4336657284d24ee196db6ae532484cf6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee710090>
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f912415-ed86-5d07-a890-2ff4c10f8551/3f912415-ed86-5d07-a890-2ff4c10f8551_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F880%252Fe7151c9a912b41a5bc9249f6b1f4cca7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/880/e7151c9a912b41a5bc9249f6b1f4cca7/images/large/1.jpg saved to cache
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f912415-ed86-5d07-a890-2ff4c10f8551
2026-03-24 18:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f912415-ed86-5d07-a890-2ff4c10f8551, skipping ID generation
2026-03-24 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f912415-ed86-5d07-a890-2ff4c10f8551 with scrape type 1
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f912415-ed86-5d07-a890-2ff4c10f8551 sending to next pipeline
2026-03-24 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f912415-ed86-5d07-a890-2ff4c10f8551, identifier: 1981368
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0fc450>
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e91bd3ca-1b9e-5f92-8b93-ffa8273261ef/e91bd3ca-1b9e-5f92-8b93-ffa8273261ef_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F495038b48a4d49ae8f1e1f2c7ff1e47f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/495038b48a4d49ae8f1e1f2c7ff1e47f/images/large/1.jpg saved to cache
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e91bd3ca-1b9e-5f92-8b93-ffa8273261ef
2026-03-24 18:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e91bd3ca-1b9e-5f92-8b93-ffa8273261ef, skipping ID generation
2026-03-24 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91bd3ca-1b9e-5f92-8b93-ffa8273261ef with scrape type 1
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e91bd3ca-1b9e-5f92-8b93-ffa8273261ef sending to next pipeline
2026-03-24 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e91bd3ca-1b9e-5f92-8b93-ffa8273261ef, identifier: 1981369
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f3250>
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb177f05-7557-586e-afa1-b883ae110eea/bb177f05-7557-586e-afa1-b883ae110eea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F873%252Fc2b8935fbb2b4175be4a81da23fbc598%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/873/c2b8935fbb2b4175be4a81da23fbc598/images/large/1.jpg saved to cache
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb177f05-7557-586e-afa1-b883ae110eea
2026-03-24 18:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb177f05-7557-586e-afa1-b883ae110eea, skipping ID generation
2026-03-24 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb177f05-7557-586e-afa1-b883ae110eea with scrape type 1
2026-03-24 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb177f05-7557-586e-afa1-b883ae110eea sending to next pipeline
2026-03-24 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb177f05-7557-586e-afa1-b883ae110eea, identifier: 1981367
2026-03-24 18:32:58 [ayvens.es] INFO: Found listing with ID: 1981377
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981377%27 HTTP/1.1" 200 None
2026-03-24 18:32:59 [ayvens.es] INFO: Scrape type for 1981377: 1
2026-03-24 18:32:59 [ayvens.es] INFO: Extracting data for car ID: 1981377
2026-03-24 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1981377
2026-03-24 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d106c-403b-5c49-b263-ad1858a4a4a8 with scrape type 1
2026-03-24 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b01d106c-403b-5c49-b263-ad1858a4a4a8
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F176%252F32111db117334c21b73b56faae81e2c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/176/32111db117334c21b73b56faae81e2c3/images/large/1.jpg not downloaded yet
2026-03-24 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1981368
2026-03-24 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1981368
2026-03-24 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1981368 to the API
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/880/e7151c9a912b41a5bc9249f6b1f4cca7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3f912415-ed86-5d07-a890-2ff4c10f8551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 137345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f912415-ed86-5d07-a890-2ff4c10f8551/3f912415-ed86-5d07-a890-2ff4c10f8551_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/880/e7151c9a912b41a5bc9249f6b1f4cca7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5p Allure PureTech 130 S&S',
 'transmission': 'manual',
 'trim': '5p Allure PureTech 130 S&S',
 'vin': None,
 'year': 2020}
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981368%27 HTTP/1.1" 200 None
2026-03-24 18:32:59 [ayvens.es] INFO: Saving data for 1981368: {'created_time': 1774377179.29516, 'last_price_update_time': 1774377179.29517, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981368') HTTP/1.1" 204 0
2026-03-24 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e91bd3ca-1b9e-5f92-8b93-ffa8273261ef with identifier: 1981369
2026-03-24 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e91bd3ca-1b9e-5f92-8b93-ffa8273261ef with identifier: 1981369
2026-03-24 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e91bd3ca-1b9e-5f92-8b93-ffa8273261ef with identifier: 1981369 to the API
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/537/495038b48a4d49ae8f1e1f2c7ff1e47f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e91bd3ca-1b9e-5f92-8b93-ffa8273261ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 58148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e91bd3ca-1b9e-5f92-8b93-ffa8273261ef/e91bd3ca-1b9e-5f92-8b93-ffa8273261ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/537/495038b48a4d49ae8f1e1f2c7ff1e47f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active Pack',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981369%27 HTTP/1.1" 200 None
2026-03-24 18:32:59 [ayvens.es] INFO: Saving data for 1981369: {'created_time': 1774377179.59591, 'last_price_update_time': 1774377179.59592, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981369') HTTP/1.1" 204 0
2026-03-24 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb177f05-7557-586e-afa1-b883ae110eea with identifier: 1981367
2026-03-24 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb177f05-7557-586e-afa1-b883ae110eea with identifier: 1981367
2026-03-24 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb177f05-7557-586e-afa1-b883ae110eea with identifier: 1981367 to the API
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/873/c2b8935fbb2b4175be4a81da23fbc598/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb177f05-7557-586e-afa1-b883ae110eea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 46572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb177f05-7557-586e-afa1-b883ae110eea/bb177f05-7557-586e-afa1-b883ae110eea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/873/c2b8935fbb2b4175be4a81da23fbc598/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981367%27 HTTP/1.1" 200 None
2026-03-24 18:32:59 [ayvens.es] INFO: Saving data for 1981367: {'created_time': 1774377179.919957, 'last_price_update_time': 1774377179.919972, 'auction_closing_time': 1774440000.0}
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981367') HTTP/1.1" 204 0
2026-03-24 18:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/428/3d0f711034ea4ecf8f99dc9ef3e55507/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:32:59 [ayvens.es] INFO: Found listing with ID: 1981378
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981378%27 HTTP/1.1" 200 None
2026-03-24 18:32:59 [ayvens.es] INFO: Scrape type for 1981378: 1
2026-03-24 18:32:59 [ayvens.es] INFO: Extracting data for car ID: 1981378
2026-03-24 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c4661d3-633d-5449-829c-2ec073e9c4d6 with identifier: 1981378
2026-03-24 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c4661d3-633d-5449-829c-2ec073e9c4d6 with scrape type 1
2026-03-24 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c4661d3-633d-5449-829c-2ec073e9c4d6
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F927%252F239dfcdb40774c32b7d6f47b28fc4109%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/927/239dfcdb40774c32b7d6f47b28fc4109/images/large/1.jpg not downloaded yet
2026-03-24 18:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7d79d0>
2026-03-24 18:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b787f4c-6a63-509b-8d09-7cc4eb051806/4b787f4c-6a63-509b-8d09-7cc4eb051806_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F452%252Fdf9ce71ef52746b083fa672b8f4f8912%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/452/df9ce71ef52746b083fa672b8f4f8912/images/large/1.jpg saved to cache
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b787f4c-6a63-509b-8d09-7cc4eb051806
2026-03-24 18:33:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b787f4c-6a63-509b-8d09-7cc4eb051806, skipping ID generation
2026-03-24 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b787f4c-6a63-509b-8d09-7cc4eb051806 with scrape type 1
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b787f4c-6a63-509b-8d09-7cc4eb051806 sending to next pipeline
2026-03-24 18:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4b787f4c-6a63-509b-8d09-7cc4eb051806, identifier: 1981370
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8c9690>
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0e0d8d2-bc66-52c1-b918-f2796f37b63f/b0e0d8d2-bc66-52c1-b918-f2796f37b63f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F294%252F4336657284d24ee196db6ae532484cf6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/294/4336657284d24ee196db6ae532484cf6/images/large/1.jpg saved to cache
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0e0d8d2-bc66-52c1-b918-f2796f37b63f
2026-03-24 18:33:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0e0d8d2-bc66-52c1-b918-f2796f37b63f, skipping ID generation
2026-03-24 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e0d8d2-bc66-52c1-b918-f2796f37b63f with scrape type 1
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0e0d8d2-bc66-52c1-b918-f2796f37b63f sending to next pipeline
2026-03-24 18:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b0e0d8d2-bc66-52c1-b918-f2796f37b63f, identifier: 1981371
2026-03-24 18:33:00 [ayvens.es] INFO: Found listing with ID: 1981379
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981379%27 HTTP/1.1" 200 None
2026-03-24 18:33:00 [ayvens.es] INFO: Scrape type for 1981379: 1
2026-03-24 18:33:00 [ayvens.es] INFO: Extracting data for car ID: 1981379
2026-03-24 18:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1981379
2026-03-24 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with scrape type 1
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F812da534e5504802bd7d4454bb7e4f09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/812da534e5504802bd7d4454bb7e4f09/images/large/1.jpg not downloaded yet
2026-03-24 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1981370
2026-03-24 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1981370
2026-03-24 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1981370 to the API
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/452/df9ce71ef52746b083fa672b8f4f8912/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4b787f4c-6a63-509b-8d09-7cc4eb051806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 95124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b787f4c-6a63-509b-8d09-7cc4eb051806/4b787f4c-6a63-509b-8d09-7cc4eb051806_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/452/df9ce71ef52746b083fa672b8f4f8912/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981370%27 HTTP/1.1" 200 None
2026-03-24 18:33:00 [ayvens.es] INFO: Saving data for 1981370: {'created_time': 1774377180.606597, 'last_price_update_time': 1774377180.606606, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981370') HTTP/1.1" 204 0
2026-03-24 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b0e0d8d2-bc66-52c1-b918-f2796f37b63f with identifier: 1981371
2026-03-24 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b0e0d8d2-bc66-52c1-b918-f2796f37b63f with identifier: 1981371
2026-03-24 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b0e0d8d2-bc66-52c1-b918-f2796f37b63f with identifier: 1981371 to the API
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/294/4336657284d24ee196db6ae532484cf6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Azul b',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b0e0d8d2-bc66-52c1-b918-f2796f37b63f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 163744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0e0d8d2-bc66-52c1-b918-f2796f37b63f/b0e0d8d2-bc66-52c1-b918-f2796f37b63f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/294/4336657284d24ee196db6ae532484cf6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Titanium HEV AT SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Titanium HEV AT SB',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981371%27 HTTP/1.1" 200 None
2026-03-24 18:33:00 [ayvens.es] INFO: Saving data for 1981371: {'created_time': 1774377180.894124, 'last_price_update_time': 1774377180.894134, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981371') HTTP/1.1" 204 0
2026-03-24 18:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/295/20e640e625894dafbddb4e50a719ffb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:00 [ayvens.es] INFO: Found listing with ID: 1981380
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981380%27 HTTP/1.1" 200 None
2026-03-24 18:33:00 [ayvens.es] INFO: Scrape type for 1981380: 1
2026-03-24 18:33:00 [ayvens.es] INFO: Extracting data for car ID: 1981380
2026-03-24 18:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1981380
2026-03-24 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6f364c-938d-5205-a1ce-85dca10d5570 with scrape type 1
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bd6f364c-938d-5205-a1ce-85dca10d5570
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F694%252F201de4efbf114400bc1f4226ed0ab546%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/694/201de4efbf114400bc1f4226ed0ab546/images/large/1.jpg not downloaded yet
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee22f550>
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2381376-e33b-50bc-905b-7f65a48fd504/f2381376-e33b-50bc-905b-7f65a48fd504_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252F3d0f711034ea4ecf8f99dc9ef3e55507%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/3d0f711034ea4ecf8f99dc9ef3e55507/images/large/1.jpg saved to cache
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2381376-e33b-50bc-905b-7f65a48fd504
2026-03-24 18:33:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2381376-e33b-50bc-905b-7f65a48fd504, skipping ID generation
2026-03-24 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2381376-e33b-50bc-905b-7f65a48fd504 with scrape type 1
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2381376-e33b-50bc-905b-7f65a48fd504 sending to next pipeline
2026-03-24 18:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2381376-e33b-50bc-905b-7f65a48fd504, identifier: 1981372
2026-03-24 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2381376-e33b-50bc-905b-7f65a48fd504 with identifier: 1981372
2026-03-24 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2381376-e33b-50bc-905b-7f65a48fd504 with identifier: 1981372
2026-03-24 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2381376-e33b-50bc-905b-7f65a48fd504 with identifier: 1981372 to the API
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/428/3d0f711034ea4ecf8f99dc9ef3e55507/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f2381376-e33b-50bc-905b-7f65a48fd504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 86795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2381376-e33b-50bc-905b-7f65a48fd504/f2381376-e33b-50bc-905b-7f65a48fd504_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/428/3d0f711034ea4ecf8f99dc9ef3e55507/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT 1.5 I3 PHEV 300 PS AWD Auto SE',
 'transmission': 'manual',
 'trim': '1.5 I3 PHEV 300 PS AWD Auto SE',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981372%27 HTTP/1.1" 200 None
2026-03-24 18:33:01 [ayvens.es] INFO: Saving data for 1981372: {'created_time': 1774377181.387521, 'last_price_update_time': 1774377181.387532, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981372') HTTP/1.1" 204 0
2026-03-24 18:33:01 [ayvens.es] INFO: Found listing with ID: 1981381
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981381%27 HTTP/1.1" 200 None
2026-03-24 18:33:01 [ayvens.es] INFO: Scrape type for 1981381: 1
2026-03-24 18:33:01 [ayvens.es] INFO: Extracting data for car ID: 1981381
2026-03-24 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1981381
2026-03-24 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65f88244-e9ab-557d-8740-d10b0511aa5d with scrape type 1
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65f88244-e9ab-557d-8740-d10b0511aa5d
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fe7cdf71f3ee24c6fb42b674334524912%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/e7cdf71f3ee24c6fb42b674334524912/images/large/1.jpg not downloaded yet
2026-03-24 18:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee984250>
2026-03-24 18:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e/b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F295%252F20e640e625894dafbddb4e50a719ffb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/295/20e640e625894dafbddb4e50a719ffb3/images/large/1.jpg saved to cache
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e
2026-03-24 18:33:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e, skipping ID generation
2026-03-24 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e with scrape type 1
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e sending to next pipeline
2026-03-24 18:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e, identifier: 1981374
2026-03-24 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/101/472fdf980e1048eb9ebe983e1f0283ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:01 [ayvens.es] INFO: Found listing with ID: 1981382
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981382%27 HTTP/1.1" 200 None
2026-03-24 18:33:01 [ayvens.es] INFO: Scrape type for 1981382: 1
2026-03-24 18:33:01 [ayvens.es] INFO: Extracting data for car ID: 1981382
2026-03-24 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79cb2d39-e3f0-5724-88ae-d5681169c92a with identifier: 1981382
2026-03-24 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79cb2d39-e3f0-5724-88ae-d5681169c92a with scrape type 1
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 79cb2d39-e3f0-5724-88ae-d5681169c92a
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F89d91a0bfddf47e39f4bc42f6def0587%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/89d91a0bfddf47e39f4bc42f6def0587/images/large/1.jpg not downloaded yet
2026-03-24 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e with identifier: 1981374
2026-03-24 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e with identifier: 1981374
2026-03-24 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e with identifier: 1981374 to the API
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/295/20e640e625894dafbddb4e50a719ffb3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Eiger grey metallic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 47839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e/b5a42f49-70ed-5c7a-ae2c-5fe484a5a38e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/295/20e640e625894dafbddb4e50a719ffb3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981374%27 HTTP/1.1" 200 None
2026-03-24 18:33:01 [ayvens.es] INFO: Saving data for 1981374: {'created_time': 1774377181.941703, 'last_price_update_time': 1774377181.941713, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981374') HTTP/1.1" 204 0
2026-03-24 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/442/363a9e4d221f4811adbd4ebefe00bbeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:01 [ayvens.es] INFO: Found listing with ID: 1981383
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981383%27 HTTP/1.1" 200 None
2026-03-24 18:33:01 [ayvens.es] INFO: Scrape type for 1981383: 1
2026-03-24 18:33:01 [ayvens.es] INFO: Extracting data for car ID: 1981383
2026-03-24 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 061e03a1-b182-551b-bc26-83609322908d with identifier: 1981383
2026-03-24 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 061e03a1-b182-551b-bc26-83609322908d with scrape type 1
2026-03-24 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 061e03a1-b182-551b-bc26-83609322908d
2026-03-24 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F209%252Fa26fd84427de4d878bccf48b89739e2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/209/a26fd84427de4d878bccf48b89739e2f/images/large/1.jpg not downloaded yet
2026-03-24 18:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/887/bac6d7fb2ff749fe851f94fa23481e5d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/927/239dfcdb40774c32b7d6f47b28fc4109/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6cd550>
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ed68cd1-ee2e-587d-b39b-c38c7061bcb8/2ed68cd1-ee2e-587d-b39b-c38c7061bcb8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F101%252F472fdf980e1048eb9ebe983e1f0283ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/101/472fdf980e1048eb9ebe983e1f0283ce/images/large/1.jpg saved to cache
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8
2026-03-24 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8, skipping ID generation
2026-03-24 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8 with scrape type 1
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8 sending to next pipeline
2026-03-24 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8, identifier: 1981375
2026-03-24 18:33:02 [ayvens.es] INFO: Found listing with ID: 1981384
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981384%27 HTTP/1.1" 200 None
2026-03-24 18:33:02 [ayvens.es] INFO: Scrape type for 1981384: 1
2026-03-24 18:33:02 [ayvens.es] INFO: Extracting data for car ID: 1981384
2026-03-24 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 052d8cd2-0fff-538f-84d9-38460af65794 with identifier: 1981384
2026-03-24 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 052d8cd2-0fff-538f-84d9-38460af65794 with scrape type 1
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 052d8cd2-0fff-538f-84d9-38460af65794
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252F5ce2d8916d4f42e78de2521221debb2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/5ce2d8916d4f42e78de2521221debb2c/images/large/1.jpg not downloaded yet
2026-03-24 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8 with identifier: 1981375
2026-03-24 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8 with identifier: 1981375
2026-03-24 18:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2ed68cd1-ee2e-587d-b39b-c38c7061bcb8 with identifier: 1981375 to the API
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/101/472fdf980e1048eb9ebe983e1f0283ce/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2ed68cd1-ee2e-587d-b39b-c38c7061bcb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 107062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed68cd1-ee2e-587d-b39b-c38c7061bcb8/2ed68cd1-ee2e-587d-b39b-c38c7061bcb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/101/472fdf980e1048eb9ebe983e1f0283ce/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981375%27 HTTP/1.1" 200 None
2026-03-24 18:33:02 [ayvens.es] INFO: Saving data for 1981375: {'created_time': 1774377182.483385, 'last_price_update_time': 1774377182.483395, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981375') HTTP/1.1" 204 0
2026-03-24 18:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/176/32111db117334c21b73b56faae81e2c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/812da534e5504802bd7d4454bb7e4f09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:02 [ayvens.es] INFO: Found listing with ID: 1981385
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981385%27 HTTP/1.1" 200 None
2026-03-24 18:33:02 [ayvens.es] INFO: Scrape type for 1981385: 1
2026-03-24 18:33:02 [ayvens.es] INFO: Extracting data for car ID: 1981385
2026-03-24 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7c1125d-8295-5e23-9dfb-594e9c430647 with identifier: 1981385
2026-03-24 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7c1125d-8295-5e23-9dfb-594e9c430647 with scrape type 1
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c7c1125d-8295-5e23-9dfb-594e9c430647
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F657%252Fbd6968f161364d42a1c1bc8308b07263%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/657/bd6968f161364d42a1c1bc8308b07263/images/large/1.jpg not downloaded yet
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb860d0>
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13130dfd-bbfd-52b9-a434-38e047dee08c/13130dfd-bbfd-52b9-a434-38e047dee08c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252F363a9e4d221f4811adbd4ebefe00bbeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/363a9e4d221f4811adbd4ebefe00bbeb/images/large/1.jpg saved to cache
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13130dfd-bbfd-52b9-a434-38e047dee08c
2026-03-24 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13130dfd-bbfd-52b9-a434-38e047dee08c, skipping ID generation
2026-03-24 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13130dfd-bbfd-52b9-a434-38e047dee08c with scrape type 1
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13130dfd-bbfd-52b9-a434-38e047dee08c sending to next pipeline
2026-03-24 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13130dfd-bbfd-52b9-a434-38e047dee08c, identifier: 1981373
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee203950>
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447f9435-365a-5fbc-a299-9e91cab52b3b/447f9435-365a-5fbc-a299-9e91cab52b3b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fbac6d7fb2ff749fe851f94fa23481e5d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/bac6d7fb2ff749fe851f94fa23481e5d/images/large/1.jpg saved to cache
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 447f9435-365a-5fbc-a299-9e91cab52b3b
2026-03-24 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 447f9435-365a-5fbc-a299-9e91cab52b3b, skipping ID generation
2026-03-24 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447f9435-365a-5fbc-a299-9e91cab52b3b with scrape type 1
2026-03-24 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 447f9435-365a-5fbc-a299-9e91cab52b3b sending to next pipeline
2026-03-24 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 447f9435-365a-5fbc-a299-9e91cab52b3b, identifier: 1981376
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6cf090>
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c4661d3-633d-5449-829c-2ec073e9c4d6/0c4661d3-633d-5449-829c-2ec073e9c4d6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F927%252F239dfcdb40774c32b7d6f47b28fc4109%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/927/239dfcdb40774c32b7d6f47b28fc4109/images/large/1.jpg saved to cache
2026-03-24 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c4661d3-633d-5449-829c-2ec073e9c4d6
2026-03-24 18:33:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c4661d3-633d-5449-829c-2ec073e9c4d6, skipping ID generation
2026-03-24 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c4661d3-633d-5449-829c-2ec073e9c4d6 with scrape type 1
2026-03-24 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c4661d3-633d-5449-829c-2ec073e9c4d6 sending to next pipeline
2026-03-24 18:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c4661d3-633d-5449-829c-2ec073e9c4d6, identifier: 1981378
2026-03-24 18:33:03 [ayvens.es] INFO: Found listing with ID: 1981386
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981386%27 HTTP/1.1" 200 None
2026-03-24 18:33:03 [ayvens.es] INFO: Scrape type for 1981386: 1
2026-03-24 18:33:03 [ayvens.es] INFO: Extracting data for car ID: 1981386
2026-03-24 18:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70b6c37-a183-534c-8d33-d8ec2ec93f60 with identifier: 1981386
2026-03-24 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70b6c37-a183-534c-8d33-d8ec2ec93f60 with scrape type 1
2026-03-24 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d70b6c37-a183-534c-8d33-d8ec2ec93f60
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252Fe28c913b20e04b4598b447b70af485a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/e28c913b20e04b4598b447b70af485a8/images/large/1.jpg not downloaded yet
2026-03-24 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1981373
2026-03-24 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1981373
2026-03-24 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1981373 to the API
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/442/363a9e4d221f4811adbd4ebefe00bbeb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '13130dfd-bbfd-52b9-a434-38e047dee08c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 130698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13130dfd-bbfd-52b9-a434-38e047dee08c/13130dfd-bbfd-52b9-a434-38e047dee08c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/442/363a9e4d221f4811adbd4ebefe00bbeb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure Pack BlueHDi 100 S&S',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 100 S&S',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981373%27 HTTP/1.1" 200 None
2026-03-24 18:33:03 [ayvens.es] INFO: Saving data for 1981373: {'created_time': 1774377183.41579, 'last_price_update_time': 1774377183.415802, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981373') HTTP/1.1" 204 0
2026-03-24 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1981376
2026-03-24 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1981376
2026-03-24 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1981376 to the API
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/887/bac6d7fb2ff749fe851f94fa23481e5d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Enigmatic black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '447f9435-365a-5fbc-a299-9e91cab52b3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 48821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_447f9435-365a-5fbc-a299-9e91cab52b3b/447f9435-365a-5fbc-a299-9e91cab52b3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/887/bac6d7fb2ff749fe851f94fa23481e5d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981376%27 HTTP/1.1" 200 None
2026-03-24 18:33:03 [ayvens.es] INFO: Saving data for 1981376: {'created_time': 1774377183.834186, 'last_price_update_time': 1774377183.834199, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981376') HTTP/1.1" 204 0
2026-03-24 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c4661d3-633d-5449-829c-2ec073e9c4d6 with identifier: 1981378
2026-03-24 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c4661d3-633d-5449-829c-2ec073e9c4d6 with identifier: 1981378
2026-03-24 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c4661d3-633d-5449-829c-2ec073e9c4d6 with identifier: 1981378 to the API
2026-03-24 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/927/239dfcdb40774c32b7d6f47b28fc4109/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c4661d3-633d-5449-829c-2ec073e9c4d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 61332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c4661d3-633d-5449-829c-2ec073e9c4d6/0c4661d3-633d-5449-829c-2ec073e9c4d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/927/239dfcdb40774c32b7d6f47b28fc4109/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 2.0 TDI 110kW (150 CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150 CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981378%27 HTTP/1.1" 200 None
2026-03-24 18:33:04 [ayvens.es] INFO: Saving data for 1981378: {'created_time': 1774377184.148351, 'last_price_update_time': 1774377184.148362, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981378') HTTP/1.1" 204 0
2026-03-24 18:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/e7cdf71f3ee24c6fb42b674334524912/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:04 [ayvens.es] INFO: Found listing with ID: 1981387
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981387%27 HTTP/1.1" 200 None
2026-03-24 18:33:04 [ayvens.es] INFO: Scrape type for 1981387: 1
2026-03-24 18:33:04 [ayvens.es] INFO: Extracting data for car ID: 1981387
2026-03-24 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1981387
2026-03-24 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49375de9-50da-5dfd-98e4-1562049e5ce4 with scrape type 1
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49375de9-50da-5dfd-98e4-1562049e5ce4
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252F7c5b501b54c54b999d172a49adf8ca19%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/7c5b501b54c54b999d172a49adf8ca19/images/large/1.jpg not downloaded yet
2026-03-24 18:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/694/201de4efbf114400bc1f4226ed0ab546/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/89d91a0bfddf47e39f4bc42f6def0587/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6fd850>
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01d106c-403b-5c49-b263-ad1858a4a4a8/b01d106c-403b-5c49-b263-ad1858a4a4a8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F176%252F32111db117334c21b73b56faae81e2c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/176/32111db117334c21b73b56faae81e2c3/images/large/1.jpg saved to cache
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b01d106c-403b-5c49-b263-ad1858a4a4a8
2026-03-24 18:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b01d106c-403b-5c49-b263-ad1858a4a4a8, skipping ID generation
2026-03-24 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d106c-403b-5c49-b263-ad1858a4a4a8 with scrape type 1
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b01d106c-403b-5c49-b263-ad1858a4a4a8 sending to next pipeline
2026-03-24 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b01d106c-403b-5c49-b263-ad1858a4a4a8, identifier: 1981377
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea3cd90>
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197/ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F812da534e5504802bd7d4454bb7e4f09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/812da534e5504802bd7d4454bb7e4f09/images/large/1.jpg saved to cache
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197
2026-03-24 18:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197, skipping ID generation
2026-03-24 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with scrape type 1
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 sending to next pipeline
2026-03-24 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197, identifier: 1981379
2026-03-24 18:33:04 [ayvens.es] INFO: Found listing with ID: 1981388
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981388%27 HTTP/1.1" 200 None
2026-03-24 18:33:04 [ayvens.es] INFO: Scrape type for 1981388: 1
2026-03-24 18:33:04 [ayvens.es] INFO: Extracting data for car ID: 1981388
2026-03-24 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1981388
2026-03-24 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c53af9-e451-521d-90e1-fba718bc3d46 with scrape type 1
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f3c53af9-e451-521d-90e1-fba718bc3d46
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252F2379ee2d83c0411ea6adb08293df387c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/2379ee2d83c0411ea6adb08293df387c/images/large/1.jpg not downloaded yet
2026-03-24 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1981377
2026-03-24 18:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1981377
2026-03-24 18:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1981377 to the API
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/176/32111db117334c21b73b56faae81e2c3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b01d106c-403b-5c49-b263-ad1858a4a4a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 102232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d106c-403b-5c49-b263-ad1858a4a4a8/b01d106c-403b-5c49-b263-ad1858a4a4a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/176/32111db117334c21b73b56faae81e2c3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981377%27 HTTP/1.1" 200 None
2026-03-24 18:33:04 [ayvens.es] INFO: Saving data for 1981377: {'created_time': 1774377184.960591, 'last_price_update_time': 1774377184.960602, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981377') HTTP/1.1" 204 0
2026-03-24 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1981379
2026-03-24 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1981379
2026-03-24 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1981379 to the API
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/812da534e5504802bd7d4454bb7e4f09/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro noche',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 115969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197/ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/812da534e5504802bd7d4454bb7e4f09/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981379%27 HTTP/1.1" 200 None
2026-03-24 18:33:05 [ayvens.es] INFO: Saving data for 1981379: {'created_time': 1774377185.244061, 'last_price_update_time': 1774377185.244072, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981379') HTTP/1.1" 204 0
2026-03-24 18:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/209/a26fd84427de4d878bccf48b89739e2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:05 [ayvens.es] INFO: Found listing with ID: 1981389
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981389%27 HTTP/1.1" 200 None
2026-03-24 18:33:05 [ayvens.es] INFO: Scrape type for 1981389: 1
2026-03-24 18:33:05 [ayvens.es] INFO: Extracting data for car ID: 1981389
2026-03-24 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306ef06d-17c3-52d9-90d2-e4b138f80866 with identifier: 1981389
2026-03-24 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306ef06d-17c3-52d9-90d2-e4b138f80866 with scrape type 1
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 306ef06d-17c3-52d9-90d2-e4b138f80866
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252F1799a0263d2344859a228f11a47307dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/1799a0263d2344859a228f11a47307dc/images/large/1.jpg not downloaded yet
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6fea90>
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f88244-e9ab-557d-8740-d10b0511aa5d/65f88244-e9ab-557d-8740-d10b0511aa5d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fe7cdf71f3ee24c6fb42b674334524912%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/e7cdf71f3ee24c6fb42b674334524912/images/large/1.jpg saved to cache
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65f88244-e9ab-557d-8740-d10b0511aa5d
2026-03-24 18:33:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65f88244-e9ab-557d-8740-d10b0511aa5d, skipping ID generation
2026-03-24 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65f88244-e9ab-557d-8740-d10b0511aa5d with scrape type 1
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65f88244-e9ab-557d-8740-d10b0511aa5d sending to next pipeline
2026-03-24 18:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 65f88244-e9ab-557d-8740-d10b0511aa5d, identifier: 1981381
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee820f50>
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6f364c-938d-5205-a1ce-85dca10d5570/bd6f364c-938d-5205-a1ce-85dca10d5570_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F694%252F201de4efbf114400bc1f4226ed0ab546%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/694/201de4efbf114400bc1f4226ed0ab546/images/large/1.jpg saved to cache
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd6f364c-938d-5205-a1ce-85dca10d5570
2026-03-24 18:33:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd6f364c-938d-5205-a1ce-85dca10d5570, skipping ID generation
2026-03-24 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6f364c-938d-5205-a1ce-85dca10d5570 with scrape type 1
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd6f364c-938d-5205-a1ce-85dca10d5570 sending to next pipeline
2026-03-24 18:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bd6f364c-938d-5205-a1ce-85dca10d5570, identifier: 1981380
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee80890>
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79cb2d39-e3f0-5724-88ae-d5681169c92a/79cb2d39-e3f0-5724-88ae-d5681169c92a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F89d91a0bfddf47e39f4bc42f6def0587%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/89d91a0bfddf47e39f4bc42f6def0587/images/large/1.jpg saved to cache
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79cb2d39-e3f0-5724-88ae-d5681169c92a
2026-03-24 18:33:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79cb2d39-e3f0-5724-88ae-d5681169c92a, skipping ID generation
2026-03-24 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79cb2d39-e3f0-5724-88ae-d5681169c92a with scrape type 1
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79cb2d39-e3f0-5724-88ae-d5681169c92a sending to next pipeline
2026-03-24 18:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 79cb2d39-e3f0-5724-88ae-d5681169c92a, identifier: 1981382
2026-03-24 18:33:05 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 266 items (at 104 items/min)
2026-03-24 18:33:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-24 18:33:05 [ayvens.es] INFO: Found listing with ID: 1981390
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981390%27 HTTP/1.1" 200 None
2026-03-24 18:33:05 [ayvens.es] INFO: Scrape type for 1981390: 1
2026-03-24 18:33:05 [ayvens.es] INFO: Extracting data for car ID: 1981390
2026-03-24 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 146f099a-aee2-566f-b787-137a73c5334b with identifier: 1981390
2026-03-24 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 146f099a-aee2-566f-b787-137a73c5334b with scrape type 1
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 146f099a-aee2-566f-b787-137a73c5334b
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F938%252F8c4abf3290a74e1eb6000f5f62c357aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/938/8c4abf3290a74e1eb6000f5f62c357aa/images/large/1.jpg not downloaded yet
2026-03-24 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1981381
2026-03-24 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1981381
2026-03-24 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1981381 to the API
2026-03-24 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/e7cdf71f3ee24c6fb42b674334524912/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Cyber gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '65f88244-e9ab-557d-8740-d10b0511aa5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 115463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f88244-e9ab-557d-8740-d10b0511aa5d/65f88244-e9ab-557d-8740-d10b0511aa5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/e7cdf71f3ee24c6fb42b674334524912/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Klass DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Klass DCT',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981381%27 HTTP/1.1" 200 None
2026-03-24 18:33:06 [ayvens.es] INFO: Saving data for 1981381: {'created_time': 1774377186.117827, 'last_price_update_time': 1774377186.117838, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981381') HTTP/1.1" 204 0
2026-03-24 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1981380
2026-03-24 18:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1981380
2026-03-24 18:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1981380 to the API
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/694/201de4efbf114400bc1f4226ed0ab546/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd6f364c-938d-5205-a1ce-85dca10d5570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 138444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6f364c-938d-5205-a1ce-85dca10d5570/bd6f364c-938d-5205-a1ce-85dca10d5570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/694/201de4efbf114400bc1f4226ed0ab546/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure Pack BlueHDi 100 S&S',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 100 S&S',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981380%27 HTTP/1.1" 200 None
2026-03-24 18:33:06 [ayvens.es] INFO: Saving data for 1981380: {'created_time': 1774377186.388181, 'last_price_update_time': 1774377186.388192, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981380') HTTP/1.1" 204 0
2026-03-24 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 79cb2d39-e3f0-5724-88ae-d5681169c92a with identifier: 1981382
2026-03-24 18:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 79cb2d39-e3f0-5724-88ae-d5681169c92a with identifier: 1981382
2026-03-24 18:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 79cb2d39-e3f0-5724-88ae-d5681169c92a with identifier: 1981382 to the API
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/89d91a0bfddf47e39f4bc42f6def0587/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Azul met',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '79cb2d39-e3f0-5724-88ae-d5681169c92a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 192316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79cb2d39-e3f0-5724-88ae-d5681169c92a/79cb2d39-e3f0-5724-88ae-d5681169c92a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/89d91a0bfddf47e39f4bc42f6def0587/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Trend HEV Auto SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Trend HEV Auto SB',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981382%27 HTTP/1.1" 200 None
2026-03-24 18:33:06 [ayvens.es] INFO: Saving data for 1981382: {'created_time': 1774377186.655131, 'last_price_update_time': 1774377186.655141, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981382') HTTP/1.1" 204 0
2026-03-24 18:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/143/5ce2d8916d4f42e78de2521221debb2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/657/bd6968f161364d42a1c1bc8308b07263/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:06 [ayvens.es] INFO: Found listing with ID: 1981391
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981391%27 HTTP/1.1" 200 None
2026-03-24 18:33:06 [ayvens.es] INFO: Scrape type for 1981391: 1
2026-03-24 18:33:06 [ayvens.es] INFO: Extracting data for car ID: 1981391
2026-03-24 18:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a207f7c8-e267-50b6-92c4-ccbfcb15468a with identifier: 1981391
2026-03-24 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a207f7c8-e267-50b6-92c4-ccbfcb15468a with scrape type 1
2026-03-24 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a207f7c8-e267-50b6-92c4-ccbfcb15468a
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F031%252F0479338446684a6ea0291129f76b2051%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/031/0479338446684a6ea0291129f76b2051/images/large/1.jpg not downloaded yet
2026-03-24 18:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7fd690>
2026-03-24 18:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e03a1-b182-551b-bc26-83609322908d/061e03a1-b182-551b-bc26-83609322908d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F209%252Fa26fd84427de4d878bccf48b89739e2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/209/a26fd84427de4d878bccf48b89739e2f/images/large/1.jpg saved to cache
2026-03-24 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 061e03a1-b182-551b-bc26-83609322908d
2026-03-24 18:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 061e03a1-b182-551b-bc26-83609322908d, skipping ID generation
2026-03-24 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 061e03a1-b182-551b-bc26-83609322908d with scrape type 1
2026-03-24 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 061e03a1-b182-551b-bc26-83609322908d sending to next pipeline
2026-03-24 18:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 061e03a1-b182-551b-bc26-83609322908d, identifier: 1981383
2026-03-24 18:33:06 [ayvens.es] INFO: Found listing with ID: 1981392
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981392%27 HTTP/1.1" 200 None
2026-03-24 18:33:06 [ayvens.es] INFO: Scrape type for 1981392: 1
2026-03-24 18:33:06 [ayvens.es] INFO: Extracting data for car ID: 1981392
2026-03-24 18:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f734e5-321d-536b-aec1-930f156e23f8 with identifier: 1981392
2026-03-24 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f734e5-321d-536b-aec1-930f156e23f8 with scrape type 1
2026-03-24 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 85f734e5-321d-536b-aec1-930f156e23f8
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F0267f90195d2487080c2dca39de81213%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/0267f90195d2487080c2dca39de81213/images/large/1.jpg not downloaded yet
2026-03-24 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 061e03a1-b182-551b-bc26-83609322908d with identifier: 1981383
2026-03-24 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 061e03a1-b182-551b-bc26-83609322908d with identifier: 1981383
2026-03-24 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 061e03a1-b182-551b-bc26-83609322908d with identifier: 1981383 to the API
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/209/a26fd84427de4d878bccf48b89739e2f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Plata florete',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '061e03a1-b182-551b-bc26-83609322908d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 83452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e03a1-b182-551b-bc26-83609322908d/061e03a1-b182-551b-bc26-83609322908d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/209/a26fd84427de4d878bccf48b89739e2f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981383%27 HTTP/1.1" 200 None
2026-03-24 18:33:07 [ayvens.es] INFO: Saving data for 1981383: {'created_time': 1774377187.209704, 'last_price_update_time': 1774377187.209713, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981383') HTTP/1.1" 204 0
2026-03-24 18:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/533/7c5b501b54c54b999d172a49adf8ca19/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/963/e28c913b20e04b4598b447b70af485a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:07 [ayvens.es] INFO: Found listing with ID: 1981393
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981393%27 HTTP/1.1" 200 None
2026-03-24 18:33:07 [ayvens.es] INFO: Scrape type for 1981393: 1
2026-03-24 18:33:07 [ayvens.es] INFO: Extracting data for car ID: 1981393
2026-03-24 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1981393
2026-03-24 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with scrape type 1
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252Facb84946d0284140bfc0ec3d6a0337f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/acb84946d0284140bfc0ec3d6a0337f7/images/large/1.jpg not downloaded yet
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee868750>
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052d8cd2-0fff-538f-84d9-38460af65794/052d8cd2-0fff-538f-84d9-38460af65794_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252F5ce2d8916d4f42e78de2521221debb2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/5ce2d8916d4f42e78de2521221debb2c/images/large/1.jpg saved to cache
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 052d8cd2-0fff-538f-84d9-38460af65794
2026-03-24 18:33:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 052d8cd2-0fff-538f-84d9-38460af65794, skipping ID generation
2026-03-24 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 052d8cd2-0fff-538f-84d9-38460af65794 with scrape type 1
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 052d8cd2-0fff-538f-84d9-38460af65794 sending to next pipeline
2026-03-24 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 052d8cd2-0fff-538f-84d9-38460af65794, identifier: 1981384
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8cbc90>
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c1125d-8295-5e23-9dfb-594e9c430647/c7c1125d-8295-5e23-9dfb-594e9c430647_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F657%252Fbd6968f161364d42a1c1bc8308b07263%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/657/bd6968f161364d42a1c1bc8308b07263/images/large/1.jpg saved to cache
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7c1125d-8295-5e23-9dfb-594e9c430647
2026-03-24 18:33:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7c1125d-8295-5e23-9dfb-594e9c430647, skipping ID generation
2026-03-24 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7c1125d-8295-5e23-9dfb-594e9c430647 with scrape type 1
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7c1125d-8295-5e23-9dfb-594e9c430647 sending to next pipeline
2026-03-24 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c7c1125d-8295-5e23-9dfb-594e9c430647, identifier: 1981385
2026-03-24 18:33:07 [ayvens.es] INFO: Found listing with ID: 1981394
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981394%27 HTTP/1.1" 200 None
2026-03-24 18:33:07 [ayvens.es] INFO: Scrape type for 1981394: 1
2026-03-24 18:33:07 [ayvens.es] INFO: Extracting data for car ID: 1981394
2026-03-24 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ce1998b-376e-52b0-b0c4-2f9d8c333a15 with identifier: 1981394
2026-03-24 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ce1998b-376e-52b0-b0c4-2f9d8c333a15 with scrape type 1
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0ce1998b-376e-52b0-b0c4-2f9d8c333a15
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F954%252Fa5e99c58561a495586981df8ca299d2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/954/a5e99c58561a495586981df8ca299d2a/images/large/1.jpg not downloaded yet
2026-03-24 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 052d8cd2-0fff-538f-84d9-38460af65794 with identifier: 1981384
2026-03-24 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 052d8cd2-0fff-538f-84d9-38460af65794 with identifier: 1981384
2026-03-24 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 052d8cd2-0fff-538f-84d9-38460af65794 with identifier: 1981384 to the API
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/143/5ce2d8916d4f42e78de2521221debb2c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '052d8cd2-0fff-538f-84d9-38460af65794',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 87476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052d8cd2-0fff-538f-84d9-38460af65794/052d8cd2-0fff-538f-84d9-38460af65794_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/143/5ce2d8916d4f42e78de2521221debb2c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981384%27 HTTP/1.1" 200 None
2026-03-24 18:33:07 [ayvens.es] INFO: Saving data for 1981384: {'created_time': 1774377187.961122, 'last_price_update_time': 1774377187.961132, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981384') HTTP/1.1" 204 0
2026-03-24 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c7c1125d-8295-5e23-9dfb-594e9c430647 with identifier: 1981385
2026-03-24 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c7c1125d-8295-5e23-9dfb-594e9c430647 with identifier: 1981385
2026-03-24 18:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c7c1125d-8295-5e23-9dfb-594e9c430647 with identifier: 1981385 to the API
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/657/bd6968f161364d42a1c1bc8308b07263/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c7c1125d-8295-5e23-9dfb-594e9c430647',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 32541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c1125d-8295-5e23-9dfb-594e9c430647/c7c1125d-8295-5e23-9dfb-594e9c430647_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/657/bd6968f161364d42a1c1bc8308b07263/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) S/S Expression L',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) S/S Expression L',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981385%27 HTTP/1.1" 200 None
2026-03-24 18:33:08 [ayvens.es] INFO: Saving data for 1981385: {'created_time': 1774377188.251371, 'last_price_update_time': 1774377188.251384, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981385') HTTP/1.1" 204 0
2026-03-24 18:33:08 [ayvens.es] INFO: Found listing with ID: 1981395
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981395%27 HTTP/1.1" 200 None
2026-03-24 18:33:08 [ayvens.es] INFO: Scrape type for 1981395: 1
2026-03-24 18:33:08 [ayvens.es] INFO: Extracting data for car ID: 1981395
2026-03-24 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c78c86-5f73-5f23-a60e-5a848f603c8b with identifier: 1981395
2026-03-24 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c78c86-5f73-5f23-a60e-5a848f603c8b with scrape type 1
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 15c78c86-5f73-5f23-a60e-5a848f603c8b
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F522%252Fd87fa5cd66e94d2d9168e9830e4bd92b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/522/d87fa5cd66e94d2d9168e9830e4bd92b/images/large/1.jpg not downloaded yet
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f3250>
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49375de9-50da-5dfd-98e4-1562049e5ce4/49375de9-50da-5dfd-98e4-1562049e5ce4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252F7c5b501b54c54b999d172a49adf8ca19%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/7c5b501b54c54b999d172a49adf8ca19/images/large/1.jpg saved to cache
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49375de9-50da-5dfd-98e4-1562049e5ce4
2026-03-24 18:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49375de9-50da-5dfd-98e4-1562049e5ce4, skipping ID generation
2026-03-24 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49375de9-50da-5dfd-98e4-1562049e5ce4 with scrape type 1
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49375de9-50da-5dfd-98e4-1562049e5ce4 sending to next pipeline
2026-03-24 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49375de9-50da-5dfd-98e4-1562049e5ce4, identifier: 1981387
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f24d0>
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d70b6c37-a183-534c-8d33-d8ec2ec93f60/d70b6c37-a183-534c-8d33-d8ec2ec93f60_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252Fe28c913b20e04b4598b447b70af485a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/e28c913b20e04b4598b447b70af485a8/images/large/1.jpg saved to cache
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d70b6c37-a183-534c-8d33-d8ec2ec93f60
2026-03-24 18:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d70b6c37-a183-534c-8d33-d8ec2ec93f60, skipping ID generation
2026-03-24 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70b6c37-a183-534c-8d33-d8ec2ec93f60 with scrape type 1
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d70b6c37-a183-534c-8d33-d8ec2ec93f60 sending to next pipeline
2026-03-24 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d70b6c37-a183-534c-8d33-d8ec2ec93f60, identifier: 1981386
2026-03-24 18:33:08 [ayvens.es] INFO: Found listing with ID: 1981396
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981396%27 HTTP/1.1" 200 None
2026-03-24 18:33:08 [ayvens.es] INFO: Scrape type for 1981396: 1
2026-03-24 18:33:08 [ayvens.es] INFO: Extracting data for car ID: 1981396
2026-03-24 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889dc5f9-40d7-5d1d-9121-5c68b033e8ba with identifier: 1981396
2026-03-24 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889dc5f9-40d7-5d1d-9121-5c68b033e8ba with scrape type 1
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 889dc5f9-40d7-5d1d-9121-5c68b033e8ba
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252Fa2a53f1514f24af5aae656756b925c31%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/a2a53f1514f24af5aae656756b925c31/images/large/1.jpg not downloaded yet
2026-03-24 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1981387
2026-03-24 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1981387
2026-03-24 18:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1981387 to the API
2026-03-24 18:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/533/7c5b501b54c54b999d172a49adf8ca19/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '49375de9-50da-5dfd-98e4-1562049e5ce4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 95817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49375de9-50da-5dfd-98e4-1562049e5ce4/49375de9-50da-5dfd-98e4-1562049e5ce4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/533/7c5b501b54c54b999d172a49adf8ca19/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) S/S Expression L',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) S/S Expression L',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981387%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [ayvens.es] INFO: Saving data for 1981387: {'created_time': 1774377190.226735, 'last_price_update_time': 1774377190.226745, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981387') HTTP/1.1" 204 0
2026-03-24 18:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d70b6c37-a183-534c-8d33-d8ec2ec93f60 with identifier: 1981386
2026-03-24 18:33:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d70b6c37-a183-534c-8d33-d8ec2ec93f60 with identifier: 1981386
2026-03-24 18:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d70b6c37-a183-534c-8d33-d8ec2ec93f60 with identifier: 1981386 to the API
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/963/e28c913b20e04b4598b447b70af485a8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Rojo elixir',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd70b6c37-a183-534c-8d33-d8ec2ec93f60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 94319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d70b6c37-a183-534c-8d33-d8ec2ec93f60/d70b6c37-a183-534c-8d33-d8ec2ec93f60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/963/e28c913b20e04b4598b447b70af485a8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 75KW (100CV) S&S Live Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 75KW (100CV) S&S Live Pack',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981386%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [ayvens.es] INFO: Saving data for 1981386: {'created_time': 1774377190.528729, 'last_price_update_time': 1774377190.528738, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981386') HTTP/1.1" 204 0
2026-03-24 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/636/2379ee2d83c0411ea6adb08293df387c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/840/1799a0263d2344859a228f11a47307dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:10 [ayvens.es] INFO: Found listing with ID: 1981397
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981397%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [ayvens.es] INFO: Scrape type for 1981397: 1
2026-03-24 18:33:10 [ayvens.es] INFO: Extracting data for car ID: 1981397
2026-03-24 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1981397
2026-03-24 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with scrape type 1
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252F7aa092307e174b10b6557e7e5b28efff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/7aa092307e174b10b6557e7e5b28efff/images/large/1.jpg not downloaded yet
2026-03-24 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/938/8c4abf3290a74e1eb6000f5f62c357aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/031/0479338446684a6ea0291129f76b2051/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:10 [ayvens.es] INFO: Found listing with ID: 1981398
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981398%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [ayvens.es] INFO: Scrape type for 1981398: 1
2026-03-24 18:33:10 [ayvens.es] INFO: Extracting data for car ID: 1981398
2026-03-24 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1981398
2026-03-24 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with scrape type 1
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252F4545552e12744b469a964b83c36825fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/4545552e12744b469a964b83c36825fa/images/large/1.jpg not downloaded yet
2026-03-24 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/418/0267f90195d2487080c2dca39de81213/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:10 [ayvens.es] INFO: Found listing with ID: 1981399
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981399%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [ayvens.es] INFO: Scrape type for 1981399: 1
2026-03-24 18:33:10 [ayvens.es] INFO: Extracting data for car ID: 1981399
2026-03-24 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb67c159-33b4-50ae-a005-e7cda46c4cd0 with identifier: 1981399
2026-03-24 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb67c159-33b4-50ae-a005-e7cda46c4cd0 with scrape type 1
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb67c159-33b4-50ae-a005-e7cda46c4cd0
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F691%252F4e49b71485994b2cb312b70e7c9715c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/691/4e49b71485994b2cb312b70e7c9715c4/images/large/1.jpg not downloaded yet
2026-03-24 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/420/acb84946d0284140bfc0ec3d6a0337f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:10 [ayvens.es] INFO: Found listing with ID: 1981400
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981400%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [ayvens.es] INFO: Scrape type for 1981400: 1
2026-03-24 18:33:10 [ayvens.es] INFO: Extracting data for car ID: 1981400
2026-03-24 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1981400
2026-03-24 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9085b26-80db-51a1-8b68-f3d2a6e0105e with scrape type 1
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a9085b26-80db-51a1-8b68-f3d2a6e0105e
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F775%252F77ee988d703b4f17885e6c0e837758cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/775/77ee988d703b4f17885e6c0e837758cf/images/large/1.jpg not downloaded yet
2026-03-24 18:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee80210>
2026-03-24 18:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c53af9-e451-521d-90e1-fba718bc3d46/f3c53af9-e451-521d-90e1-fba718bc3d46_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252F2379ee2d83c0411ea6adb08293df387c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/2379ee2d83c0411ea6adb08293df387c/images/large/1.jpg saved to cache
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3c53af9-e451-521d-90e1-fba718bc3d46
2026-03-24 18:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3c53af9-e451-521d-90e1-fba718bc3d46, skipping ID generation
2026-03-24 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c53af9-e451-521d-90e1-fba718bc3d46 with scrape type 1
2026-03-24 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3c53af9-e451-521d-90e1-fba718bc3d46 sending to next pipeline
2026-03-24 18:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f3c53af9-e451-521d-90e1-fba718bc3d46, identifier: 1981388
2026-03-24 18:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee84f790>
2026-03-24 18:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306ef06d-17c3-52d9-90d2-e4b138f80866/306ef06d-17c3-52d9-90d2-e4b138f80866_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252F1799a0263d2344859a228f11a47307dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/1799a0263d2344859a228f11a47307dc/images/large/1.jpg saved to cache
2026-03-24 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 306ef06d-17c3-52d9-90d2-e4b138f80866
2026-03-24 18:33:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 306ef06d-17c3-52d9-90d2-e4b138f80866, skipping ID generation
2026-03-24 18:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306ef06d-17c3-52d9-90d2-e4b138f80866 with scrape type 1
2026-03-24 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 306ef06d-17c3-52d9-90d2-e4b138f80866 sending to next pipeline
2026-03-24 18:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 306ef06d-17c3-52d9-90d2-e4b138f80866, identifier: 1981389
2026-03-24 18:33:11 [ayvens.es] INFO: Found listing with ID: 1981401
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981401%27 HTTP/1.1" 200 None
2026-03-24 18:33:11 [ayvens.es] INFO: Scrape type for 1981401: 1
2026-03-24 18:33:11 [ayvens.es] INFO: Extracting data for car ID: 1981401
2026-03-24 18:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1981401
2026-03-24 18:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with scrape type 1
2026-03-24 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F433%252F198157e21f5a4898b17fb943153fcb20%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/433/198157e21f5a4898b17fb943153fcb20/images/large/1.jpg not downloaded yet
2026-03-24 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1981388
2026-03-24 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1981388
2026-03-24 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1981388 to the API
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/636/2379ee2d83c0411ea6adb08293df387c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f3c53af9-e451-521d-90e1-fba718bc3d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 47473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3c53af9-e451-521d-90e1-fba718bc3d46/f3c53af9-e451-521d-90e1-fba718bc3d46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/636/2379ee2d83c0411ea6adb08293df387c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Lounge 1.2 8v 51KW (69 CV)',
 'transmission': 'manual',
 'trim': 'Lounge 1.2 8v 51KW (69 CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981388%27 HTTP/1.1" 200 None
2026-03-24 18:33:11 [ayvens.es] INFO: Saving data for 1981388: {'created_time': 1774377191.626285, 'last_price_update_time': 1774377191.626296, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981388') HTTP/1.1" 204 0
2026-03-24 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 306ef06d-17c3-52d9-90d2-e4b138f80866 with identifier: 1981389
2026-03-24 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 306ef06d-17c3-52d9-90d2-e4b138f80866 with identifier: 1981389
2026-03-24 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 306ef06d-17c3-52d9-90d2-e4b138f80866 with identifier: 1981389 to the API
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/840/1799a0263d2344859a228f11a47307dc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Gris magn',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '306ef06d-17c3-52d9-90d2-e4b138f80866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 103476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306ef06d-17c3-52d9-90d2-e4b138f80866/306ef06d-17c3-52d9-90d2-e4b138f80866_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/840/1799a0263d2344859a228f11a47307dc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost MHEV 92kW(125CV) ST-Line 5p',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost MHEV 92kW(125CV) ST-Line 5p',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981389%27 HTTP/1.1" 200 None
2026-03-24 18:33:11 [ayvens.es] INFO: Saving data for 1981389: {'created_time': 1774377191.991113, 'last_price_update_time': 1774377191.991123, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981389') HTTP/1.1" 204 0
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1df450>
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_146f099a-aee2-566f-b787-137a73c5334b/146f099a-aee2-566f-b787-137a73c5334b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F938%252F8c4abf3290a74e1eb6000f5f62c357aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/938/8c4abf3290a74e1eb6000f5f62c357aa/images/large/1.jpg saved to cache
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 146f099a-aee2-566f-b787-137a73c5334b
2026-03-24 18:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 146f099a-aee2-566f-b787-137a73c5334b, skipping ID generation
2026-03-24 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 146f099a-aee2-566f-b787-137a73c5334b with scrape type 1
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 146f099a-aee2-566f-b787-137a73c5334b sending to next pipeline
2026-03-24 18:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 146f099a-aee2-566f-b787-137a73c5334b, identifier: 1981390
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea08450>
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a207f7c8-e267-50b6-92c4-ccbfcb15468a/a207f7c8-e267-50b6-92c4-ccbfcb15468a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F031%252F0479338446684a6ea0291129f76b2051%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/031/0479338446684a6ea0291129f76b2051/images/large/1.jpg saved to cache
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a207f7c8-e267-50b6-92c4-ccbfcb15468a
2026-03-24 18:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a207f7c8-e267-50b6-92c4-ccbfcb15468a, skipping ID generation
2026-03-24 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a207f7c8-e267-50b6-92c4-ccbfcb15468a with scrape type 1
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a207f7c8-e267-50b6-92c4-ccbfcb15468a sending to next pipeline
2026-03-24 18:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a207f7c8-e267-50b6-92c4-ccbfcb15468a, identifier: 1981391
2026-03-24 18:33:12 [ayvens.es] INFO: Found listing with ID: 1981402
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981402%27 HTTP/1.1" 200 None
2026-03-24 18:33:12 [ayvens.es] INFO: Scrape type for 1981402: 1
2026-03-24 18:33:12 [ayvens.es] INFO: Extracting data for car ID: 1981402
2026-03-24 18:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd9fa7ef-4077-557b-aaf6-83440dc8278f with identifier: 1981402
2026-03-24 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd9fa7ef-4077-557b-aaf6-83440dc8278f with scrape type 1
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bd9fa7ef-4077-557b-aaf6-83440dc8278f
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Fc503b04b8a274c2bb99a9f01ac6a70e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/c503b04b8a274c2bb99a9f01ac6a70e4/images/large/1.jpg not downloaded yet
2026-03-24 18:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 146f099a-aee2-566f-b787-137a73c5334b with identifier: 1981390
2026-03-24 18:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 146f099a-aee2-566f-b787-137a73c5334b with identifier: 1981390
2026-03-24 18:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 146f099a-aee2-566f-b787-137a73c5334b with identifier: 1981390 to the API
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/938/8c4abf3290a74e1eb6000f5f62c357aa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '146f099a-aee2-566f-b787-137a73c5334b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 55188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_146f099a-aee2-566f-b787-137a73c5334b/146f099a-aee2-566f-b787-137a73c5334b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/938/8c4abf3290a74e1eb6000f5f62c357aa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981390%27 HTTP/1.1" 200 None
2026-03-24 18:33:12 [ayvens.es] INFO: Saving data for 1981390: {'created_time': 1774377192.622846, 'last_price_update_time': 1774377192.622857, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981390') HTTP/1.1" 204 0
2026-03-24 18:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a207f7c8-e267-50b6-92c4-ccbfcb15468a with identifier: 1981391
2026-03-24 18:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a207f7c8-e267-50b6-92c4-ccbfcb15468a with identifier: 1981391
2026-03-24 18:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a207f7c8-e267-50b6-92c4-ccbfcb15468a with identifier: 1981391 to the API
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/031/0479338446684a6ea0291129f76b2051/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco metropoli',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a207f7c8-e267-50b6-92c4-ccbfcb15468a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 110780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a207f7c8-e267-50b6-92c4-ccbfcb15468a/a207f7c8-e267-50b6-92c4-ccbfcb15468a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/031/0479338446684a6ea0291129f76b2051/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981391%27 HTTP/1.1" 200 None
2026-03-24 18:33:12 [ayvens.es] INFO: Saving data for 1981391: {'created_time': 1774377192.946873, 'last_price_update_time': 1774377192.946884, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981391') HTTP/1.1" 204 0
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8882d0>
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f734e5-321d-536b-aec1-930f156e23f8/85f734e5-321d-536b-aec1-930f156e23f8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F0267f90195d2487080c2dca39de81213%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/0267f90195d2487080c2dca39de81213/images/large/1.jpg saved to cache
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85f734e5-321d-536b-aec1-930f156e23f8
2026-03-24 18:33:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85f734e5-321d-536b-aec1-930f156e23f8, skipping ID generation
2026-03-24 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f734e5-321d-536b-aec1-930f156e23f8 with scrape type 1
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85f734e5-321d-536b-aec1-930f156e23f8 sending to next pipeline
2026-03-24 18:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 85f734e5-321d-536b-aec1-930f156e23f8, identifier: 1981392
2026-03-24 18:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb12110>
2026-03-24 18:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9d4a3-5be8-5889-87a0-f4cc46146c4d/d5f9d4a3-5be8-5889-87a0-f4cc46146c4d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252Facb84946d0284140bfc0ec3d6a0337f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/acb84946d0284140bfc0ec3d6a0337f7/images/large/1.jpg saved to cache
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d
2026-03-24 18:33:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d, skipping ID generation
2026-03-24 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with scrape type 1
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d sending to next pipeline
2026-03-24 18:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d, identifier: 1981393
2026-03-24 18:33:13 [ayvens.es] INFO: Found listing with ID: 1981403
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981403%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [ayvens.es] INFO: Scrape type for 1981403: 1
2026-03-24 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1981403
2026-03-24 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1981403
2026-03-24 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c052114c-6fa8-595e-b397-f38ccb691c7b with scrape type 1
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c052114c-6fa8-595e-b397-f38ccb691c7b
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F985%252F70c16354784b4b91b966b0a52b98ae30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/985/70c16354784b4b91b966b0a52b98ae30/images/large/1.jpg not downloaded yet
2026-03-24 18:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 85f734e5-321d-536b-aec1-930f156e23f8 with identifier: 1981392
2026-03-24 18:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 85f734e5-321d-536b-aec1-930f156e23f8 with identifier: 1981392
2026-03-24 18:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 85f734e5-321d-536b-aec1-930f156e23f8 with identifier: 1981392 to the API
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/418/0267f90195d2487080c2dca39de81213/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '85f734e5-321d-536b-aec1-930f156e23f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 58493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f734e5-321d-536b-aec1-930f156e23f8/85f734e5-321d-536b-aec1-930f156e23f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/418/0267f90195d2487080c2dca39de81213/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981392%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [ayvens.es] INFO: Saving data for 1981392: {'created_time': 1774377193.600246, 'last_price_update_time': 1774377193.600256, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981392') HTTP/1.1" 204 0
2026-03-24 18:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1981393
2026-03-24 18:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1981393
2026-03-24 18:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1981393 to the API
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/420/acb84946d0284140bfc0ec3d6a0337f7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Cristal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd5f9d4a3-5be8-5889-87a0-f4cc46146c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 111543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9d4a3-5be8-5889-87a0-f4cc46146c4d/d5f9d4a3-5be8-5889-87a0-f4cc46146c4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/420/acb84946d0284140bfc0ec3d6a0337f7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981393%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [ayvens.es] INFO: Saving data for 1981393: {'created_time': 1774377193.877143, 'last_price_update_time': 1774377193.877152, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981393') HTTP/1.1" 204 0
2026-03-24 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/544/4545552e12744b469a964b83c36825fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/067/7aa092307e174b10b6557e7e5b28efff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/691/4e49b71485994b2cb312b70e7c9715c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:13 [ayvens.es] INFO: Found listing with ID: 1981404
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981404%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [ayvens.es] INFO: Scrape type for 1981404: 1
2026-03-24 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1981404
2026-03-24 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71f18fd7-84cb-5ceb-817f-07426fc9a3be with identifier: 1981404
2026-03-24 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71f18fd7-84cb-5ceb-817f-07426fc9a3be with scrape type 1
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 71f18fd7-84cb-5ceb-817f-07426fc9a3be
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F551%252Fb17a061158a64838bcb488fea848b954%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/551/b17a061158a64838bcb488fea848b954/images/large/1.jpg not downloaded yet
2026-03-24 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/522/d87fa5cd66e94d2d9168e9830e4bd92b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:13 [ayvens.es] INFO: Found listing with ID: 1981405
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981405%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [ayvens.es] INFO: Scrape type for 1981405: 1
2026-03-24 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1981405
2026-03-24 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1981405
2026-03-24 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c43fea25-7c32-5258-a944-017a2fb3af24 with scrape type 1
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c43fea25-7c32-5258-a944-017a2fb3af24
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F877%252F48de5d6acfd74e73b49ec2a3bc08e780%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/877/48de5d6acfd74e73b49ec2a3bc08e780/images/large/1.jpg not downloaded yet
2026-03-24 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/228/a2a53f1514f24af5aae656756b925c31/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/954/a5e99c58561a495586981df8ca299d2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/775/77ee988d703b4f17885e6c0e837758cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:13 [ayvens.es] INFO: Found listing with ID: 1981406
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981406%27 HTTP/1.1" 200 None
2026-03-24 18:33:13 [ayvens.es] INFO: Scrape type for 1981406: 1
2026-03-24 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1981406
2026-03-24 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1981406
2026-03-24 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with scrape type 1
2026-03-24 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F78150f09663342efa200da6dbb1573d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/78150f09663342efa200da6dbb1573d9/images/large/1.jpg not downloaded yet
2026-03-24 18:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/433/198157e21f5a4898b17fb943153fcb20/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:14 [ayvens.es] INFO: Found listing with ID: 1981407
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981407%27 HTTP/1.1" 200 None
2026-03-24 18:33:14 [ayvens.es] INFO: Scrape type for 1981407: 1
2026-03-24 18:33:14 [ayvens.es] INFO: Extracting data for car ID: 1981407
2026-03-24 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1981407
2026-03-24 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6105727-b841-50f5-abdf-febcb256045e with scrape type 1
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a6105727-b841-50f5-abdf-febcb256045e
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252Feb2ab7dbb066415cabd687504726e480%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/eb2ab7dbb066415cabd687504726e480/images/large/1.jpg not downloaded yet
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1de7d0>
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05101-3041-588c-a61f-5c4fcc3ffac2/2eb05101-3041-588c-a61f-5c4fcc3ffac2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252F4545552e12744b469a964b83c36825fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/4545552e12744b469a964b83c36825fa/images/large/1.jpg saved to cache
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2
2026-03-24 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eb05101-3041-588c-a61f-5c4fcc3ffac2, skipping ID generation
2026-03-24 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with scrape type 1
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2 sending to next pipeline
2026-03-24 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2eb05101-3041-588c-a61f-5c4fcc3ffac2, identifier: 1981398
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeedab10>
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1c9f2f-4411-57bd-a171-02822d7c7a1d/0b1c9f2f-4411-57bd-a171-02822d7c7a1d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252F7aa092307e174b10b6557e7e5b28efff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/7aa092307e174b10b6557e7e5b28efff/images/large/1.jpg saved to cache
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d
2026-03-24 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d, skipping ID generation
2026-03-24 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with scrape type 1
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d sending to next pipeline
2026-03-24 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d, identifier: 1981397
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee80bd0>
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb67c159-33b4-50ae-a005-e7cda46c4cd0/bb67c159-33b4-50ae-a005-e7cda46c4cd0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F691%252F4e49b71485994b2cb312b70e7c9715c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/691/4e49b71485994b2cb312b70e7c9715c4/images/large/1.jpg saved to cache
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb67c159-33b4-50ae-a005-e7cda46c4cd0
2026-03-24 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb67c159-33b4-50ae-a005-e7cda46c4cd0, skipping ID generation
2026-03-24 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb67c159-33b4-50ae-a005-e7cda46c4cd0 with scrape type 1
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb67c159-33b4-50ae-a005-e7cda46c4cd0 sending to next pipeline
2026-03-24 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb67c159-33b4-50ae-a005-e7cda46c4cd0, identifier: 1981399
2026-03-24 18:33:14 [ayvens.es] INFO: Found listing with ID: 1981408
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981408%27 HTTP/1.1" 200 None
2026-03-24 18:33:14 [ayvens.es] INFO: Scrape type for 1981408: 1
2026-03-24 18:33:14 [ayvens.es] INFO: Extracting data for car ID: 1981408
2026-03-24 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1981408
2026-03-24 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8084af2-3760-583a-9062-ed5cd82d956c with scrape type 1
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8084af2-3760-583a-9062-ed5cd82d956c
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F834%252Faeda5308129643e3951caa2b099e3ea3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/834/aeda5308129643e3951caa2b099e3ea3/images/large/1.jpg not downloaded yet
2026-03-24 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1981398
2026-03-24 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1981398
2026-03-24 18:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1981398 to the API
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/544/4545552e12744b469a964b83c36825fa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2eb05101-3041-588c-a61f-5c4fcc3ffac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 59017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb05101-3041-588c-a61f-5c4fcc3ffac2/2eb05101-3041-588c-a61f-5c4fcc3ffac2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/544/4545552e12744b469a964b83c36825fa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981398%27 HTTP/1.1" 200 None
2026-03-24 18:33:14 [ayvens.es] INFO: Saving data for 1981398: {'created_time': 1774377194.874721, 'last_price_update_time': 1774377194.874732, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981398') HTTP/1.1" 204 0
2026-03-24 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1981397
2026-03-24 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1981397
2026-03-24 18:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1981397 to the API
2026-03-24 18:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/067/7aa092307e174b10b6557e7e5b28efff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata solar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0b1c9f2f-4411-57bd-a171-02822d7c7a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 114903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1c9f2f-4411-57bd-a171-02822d7c7a1d/0b1c9f2f-4411-57bd-a171-02822d7c7a1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/067/7aa092307e174b10b6557e7e5b28efff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981397%27 HTTP/1.1" 200 None
2026-03-24 18:33:15 [ayvens.es] INFO: Saving data for 1981397: {'created_time': 1774377195.233811, 'last_price_update_time': 1774377195.233823, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981397') HTTP/1.1" 204 0
2026-03-24 18:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb67c159-33b4-50ae-a005-e7cda46c4cd0 with identifier: 1981399
2026-03-24 18:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb67c159-33b4-50ae-a005-e7cda46c4cd0 with identifier: 1981399
2026-03-24 18:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb67c159-33b4-50ae-a005-e7cda46c4cd0 with identifier: 1981399 to the API
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/691/4e49b71485994b2cb312b70e7c9715c4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bb67c159-33b4-50ae-a005-e7cda46c4cd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-30',
 'odometer': 78944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb67c159-33b4-50ae-a005-e7cda46c4cd0/bb67c159-33b4-50ae-a005-e7cda46c4cd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/691/4e49b71485994b2cb312b70e7c9715c4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-30 e-SKYACTIV G MHEV 90kW Prime-line',
 'transmission': 'manual',
 'trim': 'e-SKYACTIV G MHEV 90kW Prime-line',
 'vin': None,
 'year': 2023}
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981399%27 HTTP/1.1" 200 None
2026-03-24 18:33:15 [ayvens.es] INFO: Saving data for 1981399: {'created_time': 1774377195.550188, 'last_price_update_time': 1774377195.5502, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981399') HTTP/1.1" 204 0
2026-03-24 18:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee20dd0>
2026-03-24 18:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c78c86-5f73-5f23-a60e-5a848f603c8b/15c78c86-5f73-5f23-a60e-5a848f603c8b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F522%252Fd87fa5cd66e94d2d9168e9830e4bd92b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/522/d87fa5cd66e94d2d9168e9830e4bd92b/images/large/1.jpg saved to cache
2026-03-24 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15c78c86-5f73-5f23-a60e-5a848f603c8b
2026-03-24 18:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15c78c86-5f73-5f23-a60e-5a848f603c8b, skipping ID generation
2026-03-24 18:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c78c86-5f73-5f23-a60e-5a848f603c8b with scrape type 1
2026-03-24 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15c78c86-5f73-5f23-a60e-5a848f603c8b sending to next pipeline
2026-03-24 18:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 15c78c86-5f73-5f23-a60e-5a848f603c8b, identifier: 1981395
2026-03-24 18:33:15 [ayvens.es] INFO: Found listing with ID: 1981409
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981409%27 HTTP/1.1" 200 None
2026-03-24 18:33:15 [ayvens.es] INFO: Scrape type for 1981409: 1
2026-03-24 18:33:15 [ayvens.es] INFO: Extracting data for car ID: 1981409
2026-03-24 18:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1838ba73-2be3-578f-91d0-8caa9df32594 with identifier: 1981409
2026-03-24 18:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1838ba73-2be3-578f-91d0-8caa9df32594 with scrape type 1
2026-03-24 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1838ba73-2be3-578f-91d0-8caa9df32594
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252Fc97a53ddd6f948de82b108da45274c18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/c97a53ddd6f948de82b108da45274c18/images/large/1.jpg not downloaded yet
2026-03-24 18:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 15c78c86-5f73-5f23-a60e-5a848f603c8b with identifier: 1981395
2026-03-24 18:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 15c78c86-5f73-5f23-a60e-5a848f603c8b with identifier: 1981395
2026-03-24 18:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 15c78c86-5f73-5f23-a60e-5a848f603c8b with identifier: 1981395 to the API
2026-03-24 18:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/522/d87fa5cd66e94d2d9168e9830e4bd92b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '15c78c86-5f73-5f23-a60e-5a848f603c8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 110206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c78c86-5f73-5f23-a60e-5a848f603c8b/15c78c86-5f73-5f23-a60e-5a848f603c8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/522/d87fa5cd66e94d2d9168e9830e4bd92b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981395%27 HTTP/1.1" 200 None
2026-03-24 18:33:16 [ayvens.es] INFO: Saving data for 1981395: {'created_time': 1774377196.112172, 'last_price_update_time': 1774377196.112182, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981395') HTTP/1.1" 204 0
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee200ed0>
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889dc5f9-40d7-5d1d-9121-5c68b033e8ba/889dc5f9-40d7-5d1d-9121-5c68b033e8ba_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252Fa2a53f1514f24af5aae656756b925c31%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/a2a53f1514f24af5aae656756b925c31/images/large/1.jpg saved to cache
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 889dc5f9-40d7-5d1d-9121-5c68b033e8ba
2026-03-24 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 889dc5f9-40d7-5d1d-9121-5c68b033e8ba, skipping ID generation
2026-03-24 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889dc5f9-40d7-5d1d-9121-5c68b033e8ba with scrape type 1
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 889dc5f9-40d7-5d1d-9121-5c68b033e8ba sending to next pipeline
2026-03-24 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 889dc5f9-40d7-5d1d-9121-5c68b033e8ba, identifier: 1981396
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee85b7d0>
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce1998b-376e-52b0-b0c4-2f9d8c333a15/0ce1998b-376e-52b0-b0c4-2f9d8c333a15_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F954%252Fa5e99c58561a495586981df8ca299d2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/954/a5e99c58561a495586981df8ca299d2a/images/large/1.jpg saved to cache
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ce1998b-376e-52b0-b0c4-2f9d8c333a15
2026-03-24 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ce1998b-376e-52b0-b0c4-2f9d8c333a15, skipping ID generation
2026-03-24 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ce1998b-376e-52b0-b0c4-2f9d8c333a15 with scrape type 1
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ce1998b-376e-52b0-b0c4-2f9d8c333a15 sending to next pipeline
2026-03-24 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0ce1998b-376e-52b0-b0c4-2f9d8c333a15, identifier: 1981394
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1fcd10>
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9085b26-80db-51a1-8b68-f3d2a6e0105e/a9085b26-80db-51a1-8b68-f3d2a6e0105e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F775%252F77ee988d703b4f17885e6c0e837758cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/775/77ee988d703b4f17885e6c0e837758cf/images/large/1.jpg saved to cache
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9085b26-80db-51a1-8b68-f3d2a6e0105e
2026-03-24 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9085b26-80db-51a1-8b68-f3d2a6e0105e, skipping ID generation
2026-03-24 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9085b26-80db-51a1-8b68-f3d2a6e0105e with scrape type 1
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9085b26-80db-51a1-8b68-f3d2a6e0105e sending to next pipeline
2026-03-24 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a9085b26-80db-51a1-8b68-f3d2a6e0105e, identifier: 1981400
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a9490>
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f56b42-fe74-5f4e-b84e-d882e3f2d136/95f56b42-fe74-5f4e-b84e-d882e3f2d136_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F433%252F198157e21f5a4898b17fb943153fcb20%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/433/198157e21f5a4898b17fb943153fcb20/images/large/1.jpg saved to cache
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136
2026-03-24 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95f56b42-fe74-5f4e-b84e-d882e3f2d136, skipping ID generation
2026-03-24 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with scrape type 1
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136 sending to next pipeline
2026-03-24 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 95f56b42-fe74-5f4e-b84e-d882e3f2d136, identifier: 1981401
2026-03-24 18:33:16 [ayvens.es] INFO: Found listing with ID: 1981410
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981410%27 HTTP/1.1" 200 None
2026-03-24 18:33:16 [ayvens.es] INFO: Scrape type for 1981410: 1
2026-03-24 18:33:16 [ayvens.es] INFO: Extracting data for car ID: 1981410
2026-03-24 18:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38cc5aac-5c72-5424-8c25-b57db1c01e9c with identifier: 1981410
2026-03-24 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38cc5aac-5c72-5424-8c25-b57db1c01e9c with scrape type 1
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 38cc5aac-5c72-5424-8c25-b57db1c01e9c
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F779%252F2ef70f7a7d214308a5adfe8ebc0d0601%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/779/2ef70f7a7d214308a5adfe8ebc0d0601/images/large/1.jpg not downloaded yet
2026-03-24 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 889dc5f9-40d7-5d1d-9121-5c68b033e8ba with identifier: 1981396
2026-03-24 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 889dc5f9-40d7-5d1d-9121-5c68b033e8ba with identifier: 1981396
2026-03-24 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 889dc5f9-40d7-5d1d-9121-5c68b033e8ba with identifier: 1981396 to the API
2026-03-24 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/228/a2a53f1514f24af5aae656756b925c31/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Gris magn',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '889dc5f9-40d7-5d1d-9121-5c68b033e8ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 61072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dc5f9-40d7-5d1d-9121-5c68b033e8ba/889dc5f9-40d7-5d1d-9121-5c68b033e8ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/228/a2a53f1514f24af5aae656756b925c31/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW (187CV) Vignale HEV AT',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW (187CV) Vignale HEV AT',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981396%27 HTTP/1.1" 200 None
2026-03-24 18:33:17 [ayvens.es] INFO: Saving data for 1981396: {'created_time': 1774377197.117266, 'last_price_update_time': 1774377197.117276, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981396') HTTP/1.1" 204 0
2026-03-24 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0ce1998b-376e-52b0-b0c4-2f9d8c333a15 with identifier: 1981394
2026-03-24 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0ce1998b-376e-52b0-b0c4-2f9d8c333a15 with identifier: 1981394
2026-03-24 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0ce1998b-376e-52b0-b0c4-2f9d8c333a15 with identifier: 1981394 to the API
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/954/a5e99c58561a495586981df8ca299d2a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0ce1998b-376e-52b0-b0c4-2f9d8c333a15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 34727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ce1998b-376e-52b0-b0c4-2f9d8c333a15/0ce1998b-376e-52b0-b0c4-2f9d8c333a15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/954/a5e99c58561a495586981df8ca299d2a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK BlueHDi 81 kW Manual SO CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 81 kW Manual SO CHIC',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981394%27 HTTP/1.1" 200 None
2026-03-24 18:33:17 [ayvens.es] INFO: Saving data for 1981394: {'created_time': 1774377197.412885, 'last_price_update_time': 1774377197.412897, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981394') HTTP/1.1" 204 0
2026-03-24 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1981400
2026-03-24 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1981400
2026-03-24 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1981400 to the API
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/775/77ee988d703b4f17885e6c0e837758cf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris acero',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a9085b26-80db-51a1-8b68-f3d2a6e0105e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 160049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9085b26-80db-51a1-8b68-f3d2a6e0105e/a9085b26-80db-51a1-8b68-f3d2a6e0105e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/775/77ee988d703b4f17885e6c0e837758cf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 PureTech 60KW (83CV) Feel',
 'transmission': 'manual',
 'trim': 'PureTech 60KW (83CV) Feel',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981400%27 HTTP/1.1" 200 None
2026-03-24 18:33:17 [ayvens.es] INFO: Saving data for 1981400: {'created_time': 1774377197.723227, 'last_price_update_time': 1774377197.723237, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981400') HTTP/1.1" 204 0
2026-03-24 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1981401
2026-03-24 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1981401
2026-03-24 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1981401 to the API
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/433/198157e21f5a4898b17fb943153fcb20/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '95f56b42-fe74-5f4e-b84e-d882e3f2d136',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 159666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f56b42-fe74-5f4e-b84e-d882e3f2d136/95f56b42-fe74-5f4e-b84e-d882e3f2d136_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/433/198157e21f5a4898b17fb943153fcb20/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981401%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [ayvens.es] INFO: Saving data for 1981401: {'created_time': 1774377198.049572, 'last_price_update_time': 1774377198.049582, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981401') HTTP/1.1" 204 0
2026-03-24 18:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/957/c503b04b8a274c2bb99a9f01ac6a70e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/877/48de5d6acfd74e73b49ec2a3bc08e780/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:18 [ayvens.es] INFO: Found listing with ID: 1981411
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981411%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [ayvens.es] INFO: Scrape type for 1981411: 1
2026-03-24 18:33:18 [ayvens.es] INFO: Extracting data for car ID: 1981411
2026-03-24 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1981411
2026-03-24 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad68b07-6b3a-5953-ba51-608233f433a9 with scrape type 1
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ad68b07-6b3a-5953-ba51-608233f433a9
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252Fdd7c20247ef84363bcd12ab23f44311b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/dd7c20247ef84363bcd12ab23f44311b/images/large/1.jpg not downloaded yet
2026-03-24 18:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/985/70c16354784b4b91b966b0a52b98ae30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/551/b17a061158a64838bcb488fea848b954/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/78150f09663342efa200da6dbb1573d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:18 [ayvens.es] INFO: Found listing with ID: 1981412
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981412%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [ayvens.es] INFO: Scrape type for 1981412: 1
2026-03-24 18:33:18 [ayvens.es] INFO: Extracting data for car ID: 1981412
2026-03-24 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceccf17f-1e17-5cb2-b8e2-4bb119b3622d with identifier: 1981412
2026-03-24 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceccf17f-1e17-5cb2-b8e2-4bb119b3622d with scrape type 1
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ceccf17f-1e17-5cb2-b8e2-4bb119b3622d
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F38601622679e41919b40ce1a19d3b80e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/38601622679e41919b40ce1a19d3b80e/images/large/1.jpg not downloaded yet
2026-03-24 18:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/834/aeda5308129643e3951caa2b099e3ea3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:18 [ayvens.es] INFO: Found listing with ID: 1981413
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981413%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [ayvens.es] INFO: Scrape type for 1981413: 1
2026-03-24 18:33:18 [ayvens.es] INFO: Extracting data for car ID: 1981413
2026-03-24 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584f096e-d603-5d05-88d7-b82a74fb7ef1 with identifier: 1981413
2026-03-24 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584f096e-d603-5d05-88d7-b82a74fb7ef1 with scrape type 1
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 584f096e-d603-5d05-88d7-b82a74fb7ef1
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F75a058a184c34c239120bc61112be884%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/75a058a184c34c239120bc61112be884/images/large/1.jpg not downloaded yet
2026-03-24 18:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/736/eb2ab7dbb066415cabd687504726e480/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:18 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6dded0>
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd9fa7ef-4077-557b-aaf6-83440dc8278f/bd9fa7ef-4077-557b-aaf6-83440dc8278f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Fc503b04b8a274c2bb99a9f01ac6a70e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/c503b04b8a274c2bb99a9f01ac6a70e4/images/large/1.jpg saved to cache
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd9fa7ef-4077-557b-aaf6-83440dc8278f
2026-03-24 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd9fa7ef-4077-557b-aaf6-83440dc8278f, skipping ID generation
2026-03-24 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd9fa7ef-4077-557b-aaf6-83440dc8278f with scrape type 1
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd9fa7ef-4077-557b-aaf6-83440dc8278f sending to next pipeline
2026-03-24 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bd9fa7ef-4077-557b-aaf6-83440dc8278f, identifier: 1981402
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08eea90>
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c43fea25-7c32-5258-a944-017a2fb3af24/c43fea25-7c32-5258-a944-017a2fb3af24_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F877%252F48de5d6acfd74e73b49ec2a3bc08e780%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/877/48de5d6acfd74e73b49ec2a3bc08e780/images/large/1.jpg saved to cache
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c43fea25-7c32-5258-a944-017a2fb3af24
2026-03-24 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c43fea25-7c32-5258-a944-017a2fb3af24, skipping ID generation
2026-03-24 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c43fea25-7c32-5258-a944-017a2fb3af24 with scrape type 1
2026-03-24 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c43fea25-7c32-5258-a944-017a2fb3af24 sending to next pipeline
2026-03-24 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c43fea25-7c32-5258-a944-017a2fb3af24, identifier: 1981405
2026-03-24 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bd9fa7ef-4077-557b-aaf6-83440dc8278f with identifier: 1981402
2026-03-24 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bd9fa7ef-4077-557b-aaf6-83440dc8278f with identifier: 1981402
2026-03-24 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bd9fa7ef-4077-557b-aaf6-83440dc8278f with identifier: 1981402 to the API
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/957/c503b04b8a274c2bb99a9f01ac6a70e4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Azul magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd9fa7ef-4077-557b-aaf6-83440dc8278f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 132417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9fa7ef-4077-557b-aaf6-83440dc8278f/bd9fa7ef-4077-557b-aaf6-83440dc8278f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/957/c503b04b8a274c2bb99a9f01ac6a70e4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 2.0 BlueHDi 133kW (180CV) S&S GT EAT8',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi 133kW (180CV) S&S GT EAT8',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981402%27 HTTP/1.1" 200 None
2026-03-24 18:33:18 [ayvens.es] INFO: Saving data for 1981402: {'created_time': 1774377198.845784, 'last_price_update_time': 1774377198.845796, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981402') HTTP/1.1" 204 0
2026-03-24 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1981405
2026-03-24 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1981405
2026-03-24 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1981405 to the API
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/877/48de5d6acfd74e73b49ec2a3bc08e780/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c43fea25-7c32-5258-a944-017a2fb3af24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 52651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c43fea25-7c32-5258-a944-017a2fb3af24/c43fea25-7c32-5258-a944-017a2fb3af24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/877/48de5d6acfd74e73b49ec2a3bc08e780/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981405%27 HTTP/1.1" 200 None
2026-03-24 18:33:19 [ayvens.es] INFO: Saving data for 1981405: {'created_time': 1774377199.23387, 'last_price_update_time': 1774377199.23388, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981405') HTTP/1.1" 204 0
2026-03-24 18:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9161d0>
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c052114c-6fa8-595e-b397-f38ccb691c7b/c052114c-6fa8-595e-b397-f38ccb691c7b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F985%252F70c16354784b4b91b966b0a52b98ae30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/985/70c16354784b4b91b966b0a52b98ae30/images/large/1.jpg saved to cache
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c052114c-6fa8-595e-b397-f38ccb691c7b
2026-03-24 18:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c052114c-6fa8-595e-b397-f38ccb691c7b, skipping ID generation
2026-03-24 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c052114c-6fa8-595e-b397-f38ccb691c7b with scrape type 1
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c052114c-6fa8-595e-b397-f38ccb691c7b sending to next pipeline
2026-03-24 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c052114c-6fa8-595e-b397-f38ccb691c7b, identifier: 1981403
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed41510>
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71f18fd7-84cb-5ceb-817f-07426fc9a3be/71f18fd7-84cb-5ceb-817f-07426fc9a3be_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F551%252Fb17a061158a64838bcb488fea848b954%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/551/b17a061158a64838bcb488fea848b954/images/large/1.jpg saved to cache
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71f18fd7-84cb-5ceb-817f-07426fc9a3be
2026-03-24 18:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71f18fd7-84cb-5ceb-817f-07426fc9a3be, skipping ID generation
2026-03-24 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71f18fd7-84cb-5ceb-817f-07426fc9a3be with scrape type 1
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71f18fd7-84cb-5ceb-817f-07426fc9a3be sending to next pipeline
2026-03-24 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 71f18fd7-84cb-5ceb-817f-07426fc9a3be, identifier: 1981404
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb11a10>
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3335a93-d1f6-53bd-b70c-b9fa24fb20bf/f3335a93-d1f6-53bd-b70c-b9fa24fb20bf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F78150f09663342efa200da6dbb1573d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/78150f09663342efa200da6dbb1573d9/images/large/1.jpg saved to cache
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf
2026-03-24 18:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf, skipping ID generation
2026-03-24 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with scrape type 1
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf sending to next pipeline
2026-03-24 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf, identifier: 1981406
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed428d0>
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8084af2-3760-583a-9062-ed5cd82d956c/c8084af2-3760-583a-9062-ed5cd82d956c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F834%252Faeda5308129643e3951caa2b099e3ea3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/834/aeda5308129643e3951caa2b099e3ea3/images/large/1.jpg saved to cache
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8084af2-3760-583a-9062-ed5cd82d956c
2026-03-24 18:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8084af2-3760-583a-9062-ed5cd82d956c, skipping ID generation
2026-03-24 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8084af2-3760-583a-9062-ed5cd82d956c with scrape type 1
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8084af2-3760-583a-9062-ed5cd82d956c sending to next pipeline
2026-03-24 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8084af2-3760-583a-9062-ed5cd82d956c, identifier: 1981408
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb721d0>
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6105727-b841-50f5-abdf-febcb256045e/a6105727-b841-50f5-abdf-febcb256045e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252Feb2ab7dbb066415cabd687504726e480%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/eb2ab7dbb066415cabd687504726e480/images/large/1.jpg saved to cache
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6105727-b841-50f5-abdf-febcb256045e
2026-03-24 18:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6105727-b841-50f5-abdf-febcb256045e, skipping ID generation
2026-03-24 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6105727-b841-50f5-abdf-febcb256045e with scrape type 1
2026-03-24 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6105727-b841-50f5-abdf-febcb256045e sending to next pipeline
2026-03-24 18:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a6105727-b841-50f5-abdf-febcb256045e, identifier: 1981407
2026-03-24 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1981403
2026-03-24 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1981403
2026-03-24 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1981403 to the API
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/985/70c16354784b4b91b966b0a52b98ae30/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c052114c-6fa8-595e-b397-f38ccb691c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 122860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c052114c-6fa8-595e-b397-f38ccb691c7b/c052114c-6fa8-595e-b397-f38ccb691c7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/985/70c16354784b4b91b966b0a52b98ae30/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981403%27 HTTP/1.1" 200 None
2026-03-24 18:33:20 [ayvens.es] INFO: Saving data for 1981403: {'created_time': 1774377200.377151, 'last_price_update_time': 1774377200.377162, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981403') HTTP/1.1" 204 0
2026-03-24 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 71f18fd7-84cb-5ceb-817f-07426fc9a3be with identifier: 1981404
2026-03-24 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 71f18fd7-84cb-5ceb-817f-07426fc9a3be with identifier: 1981404
2026-03-24 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 71f18fd7-84cb-5ceb-817f-07426fc9a3be with identifier: 1981404 to the API
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/551/b17a061158a64838bcb488fea848b954/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Gris aluminio',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '71f18fd7-84cb-5ceb-817f-07426fc9a3be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 144409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71f18fd7-84cb-5ceb-817f-07426fc9a3be/71f18fd7-84cb-5ceb-817f-07426fc9a3be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/551/b17a061158a64838bcb488fea848b954/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style 1.6 BlueHDi 120 EAT6',
 'transmission': 'manual',
 'trim': 'SW Style 1.6 BlueHDi 120 EAT6',
 'vin': None,
 'year': 2016}
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981404%27 HTTP/1.1" 200 None
2026-03-24 18:33:20 [ayvens.es] INFO: Saving data for 1981404: {'created_time': 1774377200.713765, 'last_price_update_time': 1774377200.713776, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981404') HTTP/1.1" 204 0
2026-03-24 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1981406
2026-03-24 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1981406
2026-03-24 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1981406 to the API
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/78150f09663342efa200da6dbb1573d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f3335a93-d1f6-53bd-b70c-b9fa24fb20bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 140234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3335a93-d1f6-53bd-b70c-b9fa24fb20bf/f3335a93-d1f6-53bd-b70c-b9fa24fb20bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/78150f09663342efa200da6dbb1573d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981406%27 HTTP/1.1" 200 None
2026-03-24 18:33:21 [ayvens.es] INFO: Saving data for 1981406: {'created_time': 1774377201.061726, 'last_price_update_time': 1774377201.061737, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981406') HTTP/1.1" 204 0
2026-03-24 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1981408
2026-03-24 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1981408
2026-03-24 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1981408 to the API
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/834/aeda5308129643e3951caa2b099e3ea3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c8084af2-3760-583a-9062-ed5cd82d956c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 28678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8084af2-3760-583a-9062-ed5cd82d956c/c8084af2-3760-583a-9062-ed5cd82d956c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/834/aeda5308129643e3951caa2b099e3ea3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981408%27 HTTP/1.1" 200 None
2026-03-24 18:33:21 [ayvens.es] INFO: Saving data for 1981408: {'created_time': 1774377201.384016, 'last_price_update_time': 1774377201.384026, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981408') HTTP/1.1" 204 0
2026-03-24 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1981407
2026-03-24 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1981407
2026-03-24 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1981407 to the API
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/736/eb2ab7dbb066415cabd687504726e480/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a6105727-b841-50f5-abdf-febcb256045e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 50712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6105727-b841-50f5-abdf-febcb256045e/a6105727-b841-50f5-abdf-febcb256045e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/736/eb2ab7dbb066415cabd687504726e480/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Style',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Style',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981407%27 HTTP/1.1" 200 None
2026-03-24 18:33:21 [ayvens.es] INFO: Saving data for 1981407: {'created_time': 1774377201.708856, 'last_price_update_time': 1774377201.708867, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981407') HTTP/1.1" 204 0
2026-03-24 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/779/2ef70f7a7d214308a5adfe8ebc0d0601/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/924/c97a53ddd6f948de82b108da45274c18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/415/38601622679e41919b40ce1a19d3b80e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/069/dd7c20247ef84363bcd12ab23f44311b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/186/75a058a184c34c239120bc61112be884/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6b7a90>
2026-03-24 18:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38cc5aac-5c72-5424-8c25-b57db1c01e9c/38cc5aac-5c72-5424-8c25-b57db1c01e9c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F779%252F2ef70f7a7d214308a5adfe8ebc0d0601%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/779/2ef70f7a7d214308a5adfe8ebc0d0601/images/large/1.jpg saved to cache
2026-03-24 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38cc5aac-5c72-5424-8c25-b57db1c01e9c
2026-03-24 18:33:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38cc5aac-5c72-5424-8c25-b57db1c01e9c, skipping ID generation
2026-03-24 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38cc5aac-5c72-5424-8c25-b57db1c01e9c with scrape type 1
2026-03-24 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38cc5aac-5c72-5424-8c25-b57db1c01e9c sending to next pipeline
2026-03-24 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 38cc5aac-5c72-5424-8c25-b57db1c01e9c, identifier: 1981410
2026-03-24 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 38cc5aac-5c72-5424-8c25-b57db1c01e9c with identifier: 1981410
2026-03-24 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 38cc5aac-5c72-5424-8c25-b57db1c01e9c with identifier: 1981410
2026-03-24 18:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 38cc5aac-5c72-5424-8c25-b57db1c01e9c with identifier: 1981410 to the API
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/779/2ef70f7a7d214308a5adfe8ebc0d0601/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '38cc5aac-5c72-5424-8c25-b57db1c01e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 145709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38cc5aac-5c72-5424-8c25-b57db1c01e9c/38cc5aac-5c72-5424-8c25-b57db1c01e9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/779/2ef70f7a7d214308a5adfe8ebc0d0601/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981410%27 HTTP/1.1" 200 None
2026-03-24 18:33:22 [ayvens.es] INFO: Saving data for 1981410: {'created_time': 1774377202.353804, 'last_price_update_time': 1774377202.353815, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981410') HTTP/1.1" 204 0
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9f8510>
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1838ba73-2be3-578f-91d0-8caa9df32594/1838ba73-2be3-578f-91d0-8caa9df32594_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252Fc97a53ddd6f948de82b108da45274c18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/c97a53ddd6f948de82b108da45274c18/images/large/1.jpg saved to cache
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1838ba73-2be3-578f-91d0-8caa9df32594
2026-03-24 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1838ba73-2be3-578f-91d0-8caa9df32594, skipping ID generation
2026-03-24 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1838ba73-2be3-578f-91d0-8caa9df32594 with scrape type 1
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1838ba73-2be3-578f-91d0-8caa9df32594 sending to next pipeline
2026-03-24 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1838ba73-2be3-578f-91d0-8caa9df32594, identifier: 1981409
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e7a90>
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceccf17f-1e17-5cb2-b8e2-4bb119b3622d/ceccf17f-1e17-5cb2-b8e2-4bb119b3622d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F38601622679e41919b40ce1a19d3b80e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/38601622679e41919b40ce1a19d3b80e/images/large/1.jpg saved to cache
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ceccf17f-1e17-5cb2-b8e2-4bb119b3622d
2026-03-24 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ceccf17f-1e17-5cb2-b8e2-4bb119b3622d, skipping ID generation
2026-03-24 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceccf17f-1e17-5cb2-b8e2-4bb119b3622d with scrape type 1
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ceccf17f-1e17-5cb2-b8e2-4bb119b3622d sending to next pipeline
2026-03-24 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ceccf17f-1e17-5cb2-b8e2-4bb119b3622d, identifier: 1981412
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea72f50>
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ad68b07-6b3a-5953-ba51-608233f433a9/6ad68b07-6b3a-5953-ba51-608233f433a9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252Fdd7c20247ef84363bcd12ab23f44311b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/dd7c20247ef84363bcd12ab23f44311b/images/large/1.jpg saved to cache
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ad68b07-6b3a-5953-ba51-608233f433a9
2026-03-24 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ad68b07-6b3a-5953-ba51-608233f433a9, skipping ID generation
2026-03-24 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad68b07-6b3a-5953-ba51-608233f433a9 with scrape type 1
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ad68b07-6b3a-5953-ba51-608233f433a9 sending to next pipeline
2026-03-24 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6ad68b07-6b3a-5953-ba51-608233f433a9, identifier: 1981411
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7badd0>
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_584f096e-d603-5d05-88d7-b82a74fb7ef1/584f096e-d603-5d05-88d7-b82a74fb7ef1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F75a058a184c34c239120bc61112be884%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/75a058a184c34c239120bc61112be884/images/large/1.jpg saved to cache
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 584f096e-d603-5d05-88d7-b82a74fb7ef1
2026-03-24 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 584f096e-d603-5d05-88d7-b82a74fb7ef1, skipping ID generation
2026-03-24 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584f096e-d603-5d05-88d7-b82a74fb7ef1 with scrape type 1
2026-03-24 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 584f096e-d603-5d05-88d7-b82a74fb7ef1 sending to next pipeline
2026-03-24 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 584f096e-d603-5d05-88d7-b82a74fb7ef1, identifier: 1981413
2026-03-24 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1838ba73-2be3-578f-91d0-8caa9df32594 with identifier: 1981409
2026-03-24 18:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1838ba73-2be3-578f-91d0-8caa9df32594 with identifier: 1981409
2026-03-24 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1838ba73-2be3-578f-91d0-8caa9df32594 with identifier: 1981409 to the API
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/924/c97a53ddd6f948de82b108da45274c18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1838ba73-2be3-578f-91d0-8caa9df32594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 25032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838ba73-2be3-578f-91d0-8caa9df32594/1838ba73-2be3-578f-91d0-8caa9df32594_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/924/c97a53ddd6f948de82b108da45274c18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981409%27 HTTP/1.1" 200 None
2026-03-24 18:33:23 [ayvens.es] INFO: Saving data for 1981409: {'created_time': 1774377203.325457, 'last_price_update_time': 1774377203.325467, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981409') HTTP/1.1" 204 0
2026-03-24 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ceccf17f-1e17-5cb2-b8e2-4bb119b3622d with identifier: 1981412
2026-03-24 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ceccf17f-1e17-5cb2-b8e2-4bb119b3622d with identifier: 1981412
2026-03-24 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ceccf17f-1e17-5cb2-b8e2-4bb119b3622d with identifier: 1981412 to the API
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/415/38601622679e41919b40ce1a19d3b80e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ceccf17f-1e17-5cb2-b8e2-4bb119b3622d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 145949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceccf17f-1e17-5cb2-b8e2-4bb119b3622d/ceccf17f-1e17-5cb2-b8e2-4bb119b3622d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/415/38601622679e41919b40ce1a19d3b80e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981412%27 HTTP/1.1" 200 None
2026-03-24 18:33:23 [ayvens.es] INFO: Saving data for 1981412: {'created_time': 1774377203.632367, 'last_price_update_time': 1774377203.632378, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981412') HTTP/1.1" 204 0
2026-03-24 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1981411
2026-03-24 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1981411
2026-03-24 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1981411 to the API
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/069/dd7c20247ef84363bcd12ab23f44311b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6ad68b07-6b3a-5953-ba51-608233f433a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 23961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad68b07-6b3a-5953-ba51-608233f433a9/6ad68b07-6b3a-5953-ba51-608233f433a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/069/dd7c20247ef84363bcd12ab23f44311b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981411%27 HTTP/1.1" 200 None
2026-03-24 18:33:23 [ayvens.es] INFO: Saving data for 1981411: {'created_time': 1774377203.946454, 'last_price_update_time': 1774377203.946465, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981411') HTTP/1.1" 204 0
2026-03-24 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 584f096e-d603-5d05-88d7-b82a74fb7ef1 with identifier: 1981413
2026-03-24 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 584f096e-d603-5d05-88d7-b82a74fb7ef1 with identifier: 1981413
2026-03-24 18:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 584f096e-d603-5d05-88d7-b82a74fb7ef1 with identifier: 1981413 to the API
2026-03-24 18:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/186/75a058a184c34c239120bc61112be884/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '584f096e-d603-5d05-88d7-b82a74fb7ef1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 63813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_584f096e-d603-5d05-88d7-b82a74fb7ef1/584f096e-d603-5d05-88d7-b82a74fb7ef1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/186/75a058a184c34c239120bc61112be884/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981413%27 HTTP/1.1" 200 None
2026-03-24 18:33:24 [ayvens.es] INFO: Saving data for 1981413: {'created_time': 1774377204.252282, 'last_price_update_time': 1774377204.252292, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981413') HTTP/1.1" 204 0
2026-03-24 18:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981414
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981414%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981414: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981414
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1981414
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed69733-6d18-55d5-98a2-12476ab63395 with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ed69733-6d18-55d5-98a2-12476ab63395
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252Fa491551cc6234dad997148cfe8525e6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/a491551cc6234dad997148cfe8525e6e/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981415
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981415%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981415: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981415
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7333a8fc-000a-5636-b5cb-1dc7f71586ba with identifier: 1981415
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7333a8fc-000a-5636-b5cb-1dc7f71586ba with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7333a8fc-000a-5636-b5cb-1dc7f71586ba
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F750%252Fa43bfebff8334c3395aab1559b25b3a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/750/a43bfebff8334c3395aab1559b25b3a7/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981416
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981416%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981416: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981416
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1981416
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9335d9d-23c4-513f-b5d9-ed14dae122da with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e9335d9d-23c4-513f-b5d9-ed14dae122da
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F946091e9ebc04157963b86c545ab61f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/946091e9ebc04157963b86c545ab61f5/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981417
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981417%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981417: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981417
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1981417
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27bb782-92d2-5e5b-a62f-649b59376be9 with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a27bb782-92d2-5e5b-a62f-649b59376be9
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F830%252F61c1cf744f3446c8ba1c8b16ecf90f4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/830/61c1cf744f3446c8ba1c8b16ecf90f4c/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981418
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981418%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981418: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981418
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10e5334a-5563-5acd-825d-322e8fae40c7 with identifier: 1981418
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e5334a-5563-5acd-825d-322e8fae40c7 with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 10e5334a-5563-5acd-825d-322e8fae40c7
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F927%252F96117042081b4426833fc0c24a364786%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/927/96117042081b4426833fc0c24a364786/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981419
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981419%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981419: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981419
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1981419
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33be3c2d-9dbb-5582-8836-e37a01e979bb with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33be3c2d-9dbb-5582-8836-e37a01e979bb
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F16badef64f204746ab335b6862bf7231%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/16badef64f204746ab335b6862bf7231/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981420
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981420%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981420: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981420
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1981420
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d61bf7dc-8916-5279-9d87-72767f280ea6 with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d61bf7dc-8916-5279-9d87-72767f280ea6
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F59232b5809a4492db7f48208f7ef21f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/59232b5809a4492db7f48208f7ef21f0/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981421
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981421%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981421: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981421
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1981421
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26741b3-b952-5d83-9ea1-99c2aa30b101 with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c26741b3-b952-5d83-9ea1-99c2aa30b101
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252Ff49b21ddc6954e4191b45d2186bbce66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/f49b21ddc6954e4191b45d2186bbce66/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981422
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981422%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981422: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981422
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9962b683-3073-5e65-b042-aa0f361b19ff with identifier: 1981422
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9962b683-3073-5e65-b042-aa0f361b19ff with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9962b683-3073-5e65-b042-aa0f361b19ff
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F489%252Fae2a31b28a0c4659b338933c5592bad1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/489/ae2a31b28a0c4659b338933c5592bad1/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981423
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981423%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981423: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981423
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1981423
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664cf847-5b97-5f80-b41b-f14018a9f91e with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 664cf847-5b97-5f80-b41b-f14018a9f91e
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F972%252F2c4a268df8cd4c49a3fd8b3e4f16d0dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/972/2c4a268df8cd4c49a3fd8b3e4f16d0dd/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [ayvens.es] INFO: Found listing with ID: 1981424
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981424%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [ayvens.es] INFO: Scrape type for 1981424: 1
2026-03-24 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1981424
2026-03-24 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1981424
2026-03-24 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e1952e-c5ff-5480-a2f4-89737d164955 with scrape type 1
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 47e1952e-c5ff-5480-a2f4-89737d164955
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F733%252Fdd4b3c8e94f94b849f005f620445c268%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/733/dd4b3c8e94f94b849f005f620445c268/images/large/1.jpg not downloaded yet
2026-03-24 18:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/316/946091e9ebc04157963b86c545ab61f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/750/a43bfebff8334c3395aab1559b25b3a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:27 [ayvens.es] INFO: Found listing with ID: 1981425
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981425%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [ayvens.es] INFO: Scrape type for 1981425: 1
2026-03-24 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1981425
2026-03-24 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1796453-8a2e-5b26-9a36-7c1ab2a59ad9 with identifier: 1981425
2026-03-24 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1796453-8a2e-5b26-9a36-7c1ab2a59ad9 with scrape type 1
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f1796453-8a2e-5b26-9a36-7c1ab2a59ad9
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F443a57c3f27b461dbd1dc61c2211d1be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/443a57c3f27b461dbd1dc61c2211d1be/images/large/1.jpg not downloaded yet
2026-03-24 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/409/a491551cc6234dad997148cfe8525e6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:27 [ayvens.es] INFO: Found listing with ID: 1981426
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981426%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [ayvens.es] INFO: Scrape type for 1981426: 1
2026-03-24 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1981426
2026-03-24 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd with identifier: 1981426
2026-03-24 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd with scrape type 1
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252F5b73977c8bec483ca106f9c93927459b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/5b73977c8bec483ca106f9c93927459b/images/large/1.jpg not downloaded yet
2026-03-24 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/830/61c1cf744f3446c8ba1c8b16ecf90f4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:27 [ayvens.es] INFO: Found listing with ID: 1981427
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981427%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [ayvens.es] INFO: Scrape type for 1981427: 1
2026-03-24 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1981427
2026-03-24 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f301ce-c7c2-504e-98c7-8e4639e18275 with identifier: 1981427
2026-03-24 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f301ce-c7c2-504e-98c7-8e4639e18275 with scrape type 1
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e2f301ce-c7c2-504e-98c7-8e4639e18275
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252Fbac680eae6f64430b1fbfca51f2b002c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/bac680eae6f64430b1fbfca51f2b002c/images/large/1.jpg not downloaded yet
2026-03-24 18:33:27 [ayvens.es] INFO: Found listing with ID: 1981428
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981428%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [ayvens.es] INFO: Scrape type for 1981428: 1
2026-03-24 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1981428
2026-03-24 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 017c24e7-23a7-5425-9cb6-941b0cc3e8e4 with identifier: 1981428
2026-03-24 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017c24e7-23a7-5425-9cb6-941b0cc3e8e4 with scrape type 1
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 017c24e7-23a7-5425-9cb6-941b0cc3e8e4
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F000%252Fe755f43c8af14c50bc28172132b78e9e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/000/e755f43c8af14c50bc28172132b78e9e/images/large/1.jpg not downloaded yet
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6f4190>
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9335d9d-23c4-513f-b5d9-ed14dae122da/e9335d9d-23c4-513f-b5d9-ed14dae122da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F946091e9ebc04157963b86c545ab61f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/946091e9ebc04157963b86c545ab61f5/images/large/1.jpg saved to cache
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9335d9d-23c4-513f-b5d9-ed14dae122da
2026-03-24 18:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9335d9d-23c4-513f-b5d9-ed14dae122da, skipping ID generation
2026-03-24 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9335d9d-23c4-513f-b5d9-ed14dae122da with scrape type 1
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9335d9d-23c4-513f-b5d9-ed14dae122da sending to next pipeline
2026-03-24 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e9335d9d-23c4-513f-b5d9-ed14dae122da, identifier: 1981416
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91fe290b50>
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7333a8fc-000a-5636-b5cb-1dc7f71586ba/7333a8fc-000a-5636-b5cb-1dc7f71586ba_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F750%252Fa43bfebff8334c3395aab1559b25b3a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/750/a43bfebff8334c3395aab1559b25b3a7/images/large/1.jpg saved to cache
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7333a8fc-000a-5636-b5cb-1dc7f71586ba
2026-03-24 18:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7333a8fc-000a-5636-b5cb-1dc7f71586ba, skipping ID generation
2026-03-24 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7333a8fc-000a-5636-b5cb-1dc7f71586ba with scrape type 1
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7333a8fc-000a-5636-b5cb-1dc7f71586ba sending to next pipeline
2026-03-24 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7333a8fc-000a-5636-b5cb-1dc7f71586ba, identifier: 1981415
2026-03-24 18:33:27 [ayvens.es] INFO: Found listing with ID: 1981429
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981429%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [ayvens.es] INFO: Scrape type for 1981429: 1
2026-03-24 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1981429
2026-03-24 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d2db69-988e-50e7-9428-4bea66fb2b7e with identifier: 1981429
2026-03-24 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d2db69-988e-50e7-9428-4bea66fb2b7e with scrape type 1
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 34d2db69-988e-50e7-9428-4bea66fb2b7e
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252F6f38743fc41c452087d68e82ac010845%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/6f38743fc41c452087d68e82ac010845/images/large/1.jpg not downloaded yet
2026-03-24 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1981416
2026-03-24 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1981416
2026-03-24 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1981416 to the API
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/316/946091e9ebc04157963b86c545ab61f5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Pintura s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9335d9d-23c4-513f-b5d9-ed14dae122da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 1',
 'odometer': 61112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9335d9d-23c4-513f-b5d9-ed14dae122da/e9335d9d-23c4-513f-b5d9-ed14dae122da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/316/946091e9ebc04157963b86c545ab61f5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 1 116d',
 'transmission': 'manual',
 'trim': '116d',
 'vin': None,
 'year': 2023}
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981416%27 HTTP/1.1" 200 None
2026-03-24 18:33:27 [ayvens.es] INFO: Saving data for 1981416: {'created_time': 1774377207.982763, 'last_price_update_time': 1774377207.982774, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981416') HTTP/1.1" 204 0
2026-03-24 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7333a8fc-000a-5636-b5cb-1dc7f71586ba with identifier: 1981415
2026-03-24 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7333a8fc-000a-5636-b5cb-1dc7f71586ba with identifier: 1981415
2026-03-24 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7333a8fc-000a-5636-b5cb-1dc7f71586ba with identifier: 1981415 to the API
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/750/a43bfebff8334c3395aab1559b25b3a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Perennial grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7333a8fc-000a-5636-b5cb-1dc7f71586ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 28673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7333a8fc-000a-5636-b5cb-1dc7f71586ba/7333a8fc-000a-5636-b5cb-1dc7f71586ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/750/a43bfebff8334c3395aab1559b25b3a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981415%27 HTTP/1.1" 200 None
2026-03-24 18:33:28 [ayvens.es] INFO: Saving data for 1981415: {'created_time': 1774377208.392412, 'last_price_update_time': 1774377208.392421, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981415') HTTP/1.1" 204 0
2026-03-24 18:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/489/ae2a31b28a0c4659b338933c5592bad1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef693d0>
2026-03-24 18:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed69733-6d18-55d5-98a2-12476ab63395/8ed69733-6d18-55d5-98a2-12476ab63395_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252Fa491551cc6234dad997148cfe8525e6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/a491551cc6234dad997148cfe8525e6e/images/large/1.jpg saved to cache
2026-03-24 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ed69733-6d18-55d5-98a2-12476ab63395
2026-03-24 18:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ed69733-6d18-55d5-98a2-12476ab63395, skipping ID generation
2026-03-24 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed69733-6d18-55d5-98a2-12476ab63395 with scrape type 1
2026-03-24 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ed69733-6d18-55d5-98a2-12476ab63395 sending to next pipeline
2026-03-24 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ed69733-6d18-55d5-98a2-12476ab63395, identifier: 1981414
2026-03-24 18:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/16badef64f204746ab335b6862bf7231/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/927/96117042081b4426833fc0c24a364786/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:28 [ayvens.es] INFO: Found listing with ID: 1981430
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981430%27 HTTP/1.1" 200 None
2026-03-24 18:33:28 [ayvens.es] INFO: Scrape type for 1981430: 1
2026-03-24 18:33:28 [ayvens.es] INFO: Extracting data for car ID: 1981430
2026-03-24 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bda4f6-bd46-50c1-b94a-029eaffc9124 with identifier: 1981430
2026-03-24 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bda4f6-bd46-50c1-b94a-029eaffc9124 with scrape type 1
2026-03-24 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f0bda4f6-bd46-50c1-b94a-029eaffc9124
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F815%252F4a9f4153b4bf4617a99b5e56deae8d78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/815/4a9f4153b4bf4617a99b5e56deae8d78/images/large/1.jpg not downloaded yet
2026-03-24 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1981414
2026-03-24 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1981414
2026-03-24 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1981414 to the API
2026-03-24 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/409/a491551cc6234dad997148cfe8525e6e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8ed69733-6d18-55d5-98a2-12476ab63395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 41580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed69733-6d18-55d5-98a2-12476ab63395/8ed69733-6d18-55d5-98a2-12476ab63395_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/a491551cc6234dad997148cfe8525e6e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981414%27 HTTP/1.1" 200 None
2026-03-24 18:33:29 [ayvens.es] INFO: Saving data for 1981414: {'created_time': 1774377209.520429, 'last_price_update_time': 1774377209.52044, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981414') HTTP/1.1" 204 0
2026-03-24 18:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/409/59232b5809a4492db7f48208f7ef21f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1df550>
2026-03-24 18:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27bb782-92d2-5e5b-a62f-649b59376be9/a27bb782-92d2-5e5b-a62f-649b59376be9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F830%252F61c1cf744f3446c8ba1c8b16ecf90f4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/830/61c1cf744f3446c8ba1c8b16ecf90f4c/images/large/1.jpg saved to cache
2026-03-24 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a27bb782-92d2-5e5b-a62f-649b59376be9
2026-03-24 18:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a27bb782-92d2-5e5b-a62f-649b59376be9, skipping ID generation
2026-03-24 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27bb782-92d2-5e5b-a62f-649b59376be9 with scrape type 1
2026-03-24 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a27bb782-92d2-5e5b-a62f-649b59376be9 sending to next pipeline
2026-03-24 18:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a27bb782-92d2-5e5b-a62f-649b59376be9, identifier: 1981417
2026-03-24 18:33:29 [ayvens.es] INFO: Found listing with ID: 1981431
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981431%27 HTTP/1.1" 200 None
2026-03-24 18:33:29 [ayvens.es] INFO: Scrape type for 1981431: 1
2026-03-24 18:33:29 [ayvens.es] INFO: Extracting data for car ID: 1981431
2026-03-24 18:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c95201-5a15-5135-8b28-8928b98650ff with identifier: 1981431
2026-03-24 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c95201-5a15-5135-8b28-8928b98650ff with scrape type 1
2026-03-24 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b6c95201-5a15-5135-8b28-8928b98650ff
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252Fc19122188bad4fe481fbc01a6536d89f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/c19122188bad4fe481fbc01a6536d89f/images/large/1.jpg not downloaded yet
2026-03-24 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1981417
2026-03-24 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1981417
2026-03-24 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1981417 to the API
2026-03-24 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/830/61c1cf744f3446c8ba1c8b16ecf90f4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a27bb782-92d2-5e5b-a62f-649b59376be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 77528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27bb782-92d2-5e5b-a62f-649b59376be9/a27bb782-92d2-5e5b-a62f-649b59376be9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/830/61c1cf744f3446c8ba1c8b16ecf90f4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981417%27 HTTP/1.1" 200 None
2026-03-24 18:33:31 [ayvens.es] INFO: Saving data for 1981417: {'created_time': 1774377211.54836, 'last_price_update_time': 1774377211.54837, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981417') HTTP/1.1" 204 0
2026-03-24 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/279/443a57c3f27b461dbd1dc61c2211d1be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/972/2c4a268df8cd4c49a3fd8b3e4f16d0dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:31 [ayvens.es] INFO: Found listing with ID: 1981432
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981432%27 HTTP/1.1" 200 None
2026-03-24 18:33:31 [ayvens.es] INFO: Scrape type for 1981432: 1
2026-03-24 18:33:31 [ayvens.es] INFO: Extracting data for car ID: 1981432
2026-03-24 18:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 618c0ea4-a56e-5257-9958-d986ff2450a9 with identifier: 1981432
2026-03-24 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 618c0ea4-a56e-5257-9958-d986ff2450a9 with scrape type 1
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 618c0ea4-a56e-5257-9958-d986ff2450a9
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F622%252Fc9ca9ec43c3c472886590d9a69eb5292%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/622/c9ca9ec43c3c472886590d9a69eb5292/images/large/1.jpg not downloaded yet
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8c82d0>
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9962b683-3073-5e65-b042-aa0f361b19ff/9962b683-3073-5e65-b042-aa0f361b19ff_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F489%252Fae2a31b28a0c4659b338933c5592bad1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/489/ae2a31b28a0c4659b338933c5592bad1/images/large/1.jpg saved to cache
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9962b683-3073-5e65-b042-aa0f361b19ff
2026-03-24 18:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9962b683-3073-5e65-b042-aa0f361b19ff, skipping ID generation
2026-03-24 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9962b683-3073-5e65-b042-aa0f361b19ff with scrape type 1
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9962b683-3073-5e65-b042-aa0f361b19ff sending to next pipeline
2026-03-24 18:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9962b683-3073-5e65-b042-aa0f361b19ff, identifier: 1981422
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1d6bd0>
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33be3c2d-9dbb-5582-8836-e37a01e979bb/33be3c2d-9dbb-5582-8836-e37a01e979bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F16badef64f204746ab335b6862bf7231%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/16badef64f204746ab335b6862bf7231/images/large/1.jpg saved to cache
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33be3c2d-9dbb-5582-8836-e37a01e979bb
2026-03-24 18:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33be3c2d-9dbb-5582-8836-e37a01e979bb, skipping ID generation
2026-03-24 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33be3c2d-9dbb-5582-8836-e37a01e979bb with scrape type 1
2026-03-24 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33be3c2d-9dbb-5582-8836-e37a01e979bb sending to next pipeline
2026-03-24 18:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33be3c2d-9dbb-5582-8836-e37a01e979bb, identifier: 1981419
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee968ad0>
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e5334a-5563-5acd-825d-322e8fae40c7/10e5334a-5563-5acd-825d-322e8fae40c7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F927%252F96117042081b4426833fc0c24a364786%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/927/96117042081b4426833fc0c24a364786/images/large/1.jpg saved to cache
2026-03-24 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10e5334a-5563-5acd-825d-322e8fae40c7
2026-03-24 18:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10e5334a-5563-5acd-825d-322e8fae40c7, skipping ID generation
2026-03-24 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e5334a-5563-5acd-825d-322e8fae40c7 with scrape type 1
2026-03-24 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10e5334a-5563-5acd-825d-322e8fae40c7 sending to next pipeline
2026-03-24 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 10e5334a-5563-5acd-825d-322e8fae40c7, identifier: 1981418
2026-03-24 18:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea3d950>
2026-03-24 18:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61bf7dc-8916-5279-9d87-72767f280ea6/d61bf7dc-8916-5279-9d87-72767f280ea6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F59232b5809a4492db7f48208f7ef21f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/59232b5809a4492db7f48208f7ef21f0/images/large/1.jpg saved to cache
2026-03-24 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d61bf7dc-8916-5279-9d87-72767f280ea6
2026-03-24 18:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d61bf7dc-8916-5279-9d87-72767f280ea6, skipping ID generation
2026-03-24 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d61bf7dc-8916-5279-9d87-72767f280ea6 with scrape type 1
2026-03-24 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d61bf7dc-8916-5279-9d87-72767f280ea6 sending to next pipeline
2026-03-24 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d61bf7dc-8916-5279-9d87-72767f280ea6, identifier: 1981420
2026-03-24 18:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/088/f49b21ddc6954e4191b45d2186bbce66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9962b683-3073-5e65-b042-aa0f361b19ff with identifier: 1981422
2026-03-24 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9962b683-3073-5e65-b042-aa0f361b19ff with identifier: 1981422
2026-03-24 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9962b683-3073-5e65-b042-aa0f361b19ff with identifier: 1981422 to the API
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/489/ae2a31b28a0c4659b338933c5592bad1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9962b683-3073-5e65-b042-aa0f361b19ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 90709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9962b683-3073-5e65-b042-aa0f361b19ff/9962b683-3073-5e65-b042-aa0f361b19ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/489/ae2a31b28a0c4659b338933c5592bad1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981422%27 HTTP/1.1" 200 None
2026-03-24 18:33:32 [ayvens.es] INFO: Saving data for 1981422: {'created_time': 1774377212.696324, 'last_price_update_time': 1774377212.696333, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981422') HTTP/1.1" 204 0
2026-03-24 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1981419
2026-03-24 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1981419
2026-03-24 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1981419 to the API
2026-03-24 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/16badef64f204746ab335b6862bf7231/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '33be3c2d-9dbb-5582-8836-e37a01e979bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 79799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be3c2d-9dbb-5582-8836-e37a01e979bb/33be3c2d-9dbb-5582-8836-e37a01e979bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/16badef64f204746ab335b6862bf7231/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981419%27 HTTP/1.1" 200 None
2026-03-24 18:33:33 [ayvens.es] INFO: Saving data for 1981419: {'created_time': 1774377213.601557, 'last_price_update_time': 1774377213.601567, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981419') HTTP/1.1" 204 0
2026-03-24 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 10e5334a-5563-5acd-825d-322e8fae40c7 with identifier: 1981418
2026-03-24 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 10e5334a-5563-5acd-825d-322e8fae40c7 with identifier: 1981418
2026-03-24 18:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 10e5334a-5563-5acd-825d-322e8fae40c7 with identifier: 1981418 to the API
2026-03-24 18:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/927/96117042081b4426833fc0c24a364786/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '10e5334a-5563-5acd-825d-322e8fae40c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 125512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e5334a-5563-5acd-825d-322e8fae40c7/10e5334a-5563-5acd-825d-322e8fae40c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/927/96117042081b4426833fc0c24a364786/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981418%27 HTTP/1.1" 200 None
2026-03-24 18:33:34 [ayvens.es] INFO: Saving data for 1981418: {'created_time': 1774377214.038726, 'last_price_update_time': 1774377214.038738, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981418') HTTP/1.1" 204 0
2026-03-24 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1981420
2026-03-24 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1981420
2026-03-24 18:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1981420 to the API
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/409/59232b5809a4492db7f48208f7ef21f0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd61bf7dc-8916-5279-9d87-72767f280ea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 33032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61bf7dc-8916-5279-9d87-72767f280ea6/d61bf7dc-8916-5279-9d87-72767f280ea6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/59232b5809a4492db7f48208f7ef21f0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2023}
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981420%27 HTTP/1.1" 200 None
2026-03-24 18:33:34 [ayvens.es] INFO: Saving data for 1981420: {'created_time': 1774377214.35806, 'last_price_update_time': 1774377214.35807, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981420') HTTP/1.1" 204 0
2026-03-24 18:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/733/dd4b3c8e94f94b849f005f620445c268/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:34 [ayvens.es] INFO: Found listing with ID: 1981433
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981433%27 HTTP/1.1" 200 None
2026-03-24 18:33:34 [ayvens.es] INFO: Scrape type for 1981433: 1
2026-03-24 18:33:34 [ayvens.es] INFO: Extracting data for car ID: 1981433
2026-03-24 18:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1d2459-98a4-52a9-88a3-b1757c62f8d1 with identifier: 1981433
2026-03-24 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1d2459-98a4-52a9-88a3-b1757c62f8d1 with scrape type 1
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0b1d2459-98a4-52a9-88a3-b1757c62f8d1
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F6b9dc2ac4ad342ad9dab03aa032891ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/6b9dc2ac4ad342ad9dab03aa032891ba/images/large/1.jpg not downloaded yet
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee250250>
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1796453-8a2e-5b26-9a36-7c1ab2a59ad9/f1796453-8a2e-5b26-9a36-7c1ab2a59ad9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F443a57c3f27b461dbd1dc61c2211d1be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/443a57c3f27b461dbd1dc61c2211d1be/images/large/1.jpg saved to cache
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1796453-8a2e-5b26-9a36-7c1ab2a59ad9
2026-03-24 18:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1796453-8a2e-5b26-9a36-7c1ab2a59ad9, skipping ID generation
2026-03-24 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1796453-8a2e-5b26-9a36-7c1ab2a59ad9 with scrape type 1
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1796453-8a2e-5b26-9a36-7c1ab2a59ad9 sending to next pipeline
2026-03-24 18:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f1796453-8a2e-5b26-9a36-7c1ab2a59ad9, identifier: 1981425
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a06d0>
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_664cf847-5b97-5f80-b41b-f14018a9f91e/664cf847-5b97-5f80-b41b-f14018a9f91e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F972%252F2c4a268df8cd4c49a3fd8b3e4f16d0dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/972/2c4a268df8cd4c49a3fd8b3e4f16d0dd/images/large/1.jpg saved to cache
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 664cf847-5b97-5f80-b41b-f14018a9f91e
2026-03-24 18:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 664cf847-5b97-5f80-b41b-f14018a9f91e, skipping ID generation
2026-03-24 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664cf847-5b97-5f80-b41b-f14018a9f91e with scrape type 1
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 664cf847-5b97-5f80-b41b-f14018a9f91e sending to next pipeline
2026-03-24 18:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 664cf847-5b97-5f80-b41b-f14018a9f91e, identifier: 1981423
2026-03-24 18:33:34 [ayvens.es] INFO: Found listing with ID: 1981434
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981434%27 HTTP/1.1" 200 None
2026-03-24 18:33:34 [ayvens.es] INFO: Scrape type for 1981434: 1
2026-03-24 18:33:34 [ayvens.es] INFO: Extracting data for car ID: 1981434
2026-03-24 18:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58853889-c8b8-57ca-a581-49e70dc042c6 with identifier: 1981434
2026-03-24 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58853889-c8b8-57ca-a581-49e70dc042c6 with scrape type 1
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58853889-c8b8-57ca-a581-49e70dc042c6
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252F278cf8c1d2c94803a32fac736f63c03e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/278cf8c1d2c94803a32fac736f63c03e/images/large/1.jpg not downloaded yet
2026-03-24 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f1796453-8a2e-5b26-9a36-7c1ab2a59ad9 with identifier: 1981425
2026-03-24 18:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f1796453-8a2e-5b26-9a36-7c1ab2a59ad9 with identifier: 1981425
2026-03-24 18:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f1796453-8a2e-5b26-9a36-7c1ab2a59ad9 with identifier: 1981425 to the API
2026-03-24 18:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/279/443a57c3f27b461dbd1dc61c2211d1be/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f1796453-8a2e-5b26-9a36-7c1ab2a59ad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 100424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1796453-8a2e-5b26-9a36-7c1ab2a59ad9/f1796453-8a2e-5b26-9a36-7c1ab2a59ad9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/279/443a57c3f27b461dbd1dc61c2211d1be/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Lounge 1.2 8v 51KW (69 CV)',
 'transmission': 'manual',
 'trim': 'Lounge 1.2 8v 51KW (69 CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981425%27 HTTP/1.1" 200 None
2026-03-24 18:33:35 [ayvens.es] INFO: Saving data for 1981425: {'created_time': 1774377215.278656, 'last_price_update_time': 1774377215.278673, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981425') HTTP/1.1" 204 0
2026-03-24 18:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1981423
2026-03-24 18:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1981423
2026-03-24 18:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1981423 to the API
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/972/2c4a268df8cd4c49a3fd8b3e4f16d0dd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '664cf847-5b97-5f80-b41b-f14018a9f91e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 43633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_664cf847-5b97-5f80-b41b-f14018a9f91e/664cf847-5b97-5f80-b41b-f14018a9f91e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/972/2c4a268df8cd4c49a3fd8b3e4f16d0dd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981423%27 HTTP/1.1" 200 None
2026-03-24 18:33:35 [ayvens.es] INFO: Saving data for 1981423: {'created_time': 1774377215.608696, 'last_price_update_time': 1774377215.608709, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981423') HTTP/1.1" 204 0
2026-03-24 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/134/5b73977c8bec483ca106f9c93927459b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/000/e755f43c8af14c50bc28172132b78e9e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/514/bac680eae6f64430b1fbfca51f2b002c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7bb5d0>
2026-03-24 18:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c26741b3-b952-5d83-9ea1-99c2aa30b101/c26741b3-b952-5d83-9ea1-99c2aa30b101_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252Ff49b21ddc6954e4191b45d2186bbce66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/f49b21ddc6954e4191b45d2186bbce66/images/large/1.jpg saved to cache
2026-03-24 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c26741b3-b952-5d83-9ea1-99c2aa30b101
2026-03-24 18:33:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c26741b3-b952-5d83-9ea1-99c2aa30b101, skipping ID generation
2026-03-24 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26741b3-b952-5d83-9ea1-99c2aa30b101 with scrape type 1
2026-03-24 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c26741b3-b952-5d83-9ea1-99c2aa30b101 sending to next pipeline
2026-03-24 18:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c26741b3-b952-5d83-9ea1-99c2aa30b101, identifier: 1981421
2026-03-24 18:33:35 [ayvens.es] INFO: Found listing with ID: 1981435
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981435%27 HTTP/1.1" 200 None
2026-03-24 18:33:35 [ayvens.es] INFO: Scrape type for 1981435: 1
2026-03-24 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1981435
2026-03-24 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1981435
2026-03-24 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f with scrape type 1
2026-03-24 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F17ed194f41e84a02a2a972e833a14f32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/17ed194f41e84a02a2a972e833a14f32/images/large/1.jpg not downloaded yet
2026-03-24 18:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1981421
2026-03-24 18:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1981421
2026-03-24 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1981421 to the API
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/088/f49b21ddc6954e4191b45d2186bbce66/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris oscuro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c26741b3-b952-5d83-9ea1-99c2aa30b101',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 66976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c26741b3-b952-5d83-9ea1-99c2aa30b101/c26741b3-b952-5d83-9ea1-99c2aa30b101_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/088/f49b21ddc6954e4191b45d2186bbce66/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Pack Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981421%27 HTTP/1.1" 200 None
2026-03-24 18:33:36 [ayvens.es] INFO: Saving data for 1981421: {'created_time': 1774377216.253604, 'last_price_update_time': 1774377216.25362, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981421') HTTP/1.1" 204 0
2026-03-24 18:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea03f10>
2026-03-24 18:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e1952e-c5ff-5480-a2f4-89737d164955/47e1952e-c5ff-5480-a2f4-89737d164955_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F733%252Fdd4b3c8e94f94b849f005f620445c268%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/733/dd4b3c8e94f94b849f005f620445c268/images/large/1.jpg saved to cache
2026-03-24 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47e1952e-c5ff-5480-a2f4-89737d164955
2026-03-24 18:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47e1952e-c5ff-5480-a2f4-89737d164955, skipping ID generation
2026-03-24 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e1952e-c5ff-5480-a2f4-89737d164955 with scrape type 1
2026-03-24 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47e1952e-c5ff-5480-a2f4-89737d164955 sending to next pipeline
2026-03-24 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 47e1952e-c5ff-5480-a2f4-89737d164955, identifier: 1981424
2026-03-24 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/382/6f38743fc41c452087d68e82ac010845/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1981424
2026-03-24 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1981424
2026-03-24 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1981424 to the API
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/733/dd4b3c8e94f94b849f005f620445c268/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '47e1952e-c5ff-5480-a2f4-89737d164955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 73109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e1952e-c5ff-5480-a2f4-89737d164955/47e1952e-c5ff-5480-a2f4-89737d164955_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/733/dd4b3c8e94f94b849f005f620445c268/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT Line EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT Line EAT8',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981424%27 HTTP/1.1" 200 None
2026-03-24 18:33:36 [ayvens.es] INFO: Saving data for 1981424: {'created_time': 1774377216.769126, 'last_price_update_time': 1774377216.769136, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981424') HTTP/1.1" 204 0
2026-03-24 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/815/4a9f4153b4bf4617a99b5e56deae8d78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:36 [ayvens.es] INFO: Found listing with ID: 1981436
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981436%27 HTTP/1.1" 200 None
2026-03-24 18:33:36 [ayvens.es] INFO: Scrape type for 1981436: 1
2026-03-24 18:33:36 [ayvens.es] INFO: Extracting data for car ID: 1981436
2026-03-24 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1981436
2026-03-24 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8feb59be-6f6c-5439-a973-a60bbc9e7175 with scrape type 1
2026-03-24 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8feb59be-6f6c-5439-a973-a60bbc9e7175
2026-03-24 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8feb59be-6f6c-5439-a973-a60bbc9e7175
2026-03-24 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8feb59be-6f6c-5439-a973-a60bbc9e7175, identifier: 1981436
2026-03-24 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/422/c19122188bad4fe481fbc01a6536d89f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1981436
2026-03-24 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1981436
2026-03-24 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1981436 to the API
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8feb59be-6f6c-5439-a973-a60bbc9e7175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 88040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P GT PureTech 180 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P GT PureTech 180 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981436%27 HTTP/1.1" 200 None
2026-03-24 18:33:37 [ayvens.es] INFO: Saving data for 1981436: {'created_time': 1774377217.17916, 'last_price_update_time': 1774377217.179172, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981436') HTTP/1.1" 204 0
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb60e90>
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3ff301-c66f-5957-8c7c-3b8c5db6fefd/0f3ff301-c66f-5957-8c7c-3b8c5db6fefd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252F5b73977c8bec483ca106f9c93927459b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/5b73977c8bec483ca106f9c93927459b/images/large/1.jpg saved to cache
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd
2026-03-24 18:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd, skipping ID generation
2026-03-24 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd with scrape type 1
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd sending to next pipeline
2026-03-24 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd, identifier: 1981426
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef5cf10>
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017c24e7-23a7-5425-9cb6-941b0cc3e8e4/017c24e7-23a7-5425-9cb6-941b0cc3e8e4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F000%252Fe755f43c8af14c50bc28172132b78e9e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/000/e755f43c8af14c50bc28172132b78e9e/images/large/1.jpg saved to cache
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 017c24e7-23a7-5425-9cb6-941b0cc3e8e4
2026-03-24 18:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 017c24e7-23a7-5425-9cb6-941b0cc3e8e4, skipping ID generation
2026-03-24 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017c24e7-23a7-5425-9cb6-941b0cc3e8e4 with scrape type 1
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 017c24e7-23a7-5425-9cb6-941b0cc3e8e4 sending to next pipeline
2026-03-24 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 017c24e7-23a7-5425-9cb6-941b0cc3e8e4, identifier: 1981428
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb72c90>
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f301ce-c7c2-504e-98c7-8e4639e18275/e2f301ce-c7c2-504e-98c7-8e4639e18275_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252Fbac680eae6f64430b1fbfca51f2b002c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/bac680eae6f64430b1fbfca51f2b002c/images/large/1.jpg saved to cache
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2f301ce-c7c2-504e-98c7-8e4639e18275
2026-03-24 18:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2f301ce-c7c2-504e-98c7-8e4639e18275, skipping ID generation
2026-03-24 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f301ce-c7c2-504e-98c7-8e4639e18275 with scrape type 1
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2f301ce-c7c2-504e-98c7-8e4639e18275 sending to next pipeline
2026-03-24 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e2f301ce-c7c2-504e-98c7-8e4639e18275, identifier: 1981427
2026-03-24 18:33:37 [ayvens.es] INFO: Found listing with ID: 1981437
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981437%27 HTTP/1.1" 200 None
2026-03-24 18:33:37 [ayvens.es] INFO: Scrape type for 1981437: 1
2026-03-24 18:33:37 [ayvens.es] INFO: Extracting data for car ID: 1981437
2026-03-24 18:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1981437
2026-03-24 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35705818-60a6-5729-95b3-94a5b53e2ba7 with scrape type 1
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35705818-60a6-5729-95b3-94a5b53e2ba7
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F091%252Fd90c17993e8840fc84508638162a8094%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/091/d90c17993e8840fc84508638162a8094/images/large/1.jpg not downloaded yet
2026-03-24 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd with identifier: 1981426
2026-03-24 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd with identifier: 1981426
2026-03-24 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0f3ff301-c66f-5957-8c7c-3b8c5db6fefd with identifier: 1981426 to the API
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/134/5b73977c8bec483ca106f9c93927459b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco okenite metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f3ff301-c66f-5957-8c7c-3b8c5db6fefd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 2445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3ff301-c66f-5957-8c7c-3b8c5db6fefd/0f3ff301-c66f-5957-8c7c-3b8c5db6fefd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/134/5b73977c8bec483ca106f9c93927459b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Allure Puretech 100 S&S 6 Vel. MAN',
 'transmission': 'manual',
 'trim': 'Allure Puretech 100 S&S 6 Vel. MAN',
 'vin': None,
 'year': 2025}
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981426%27 HTTP/1.1" 200 None
2026-03-24 18:33:37 [ayvens.es] INFO: Saving data for 1981426: {'created_time': 1774377217.990588, 'last_price_update_time': 1774377217.990599, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981426') HTTP/1.1" 204 0
2026-03-24 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 017c24e7-23a7-5425-9cb6-941b0cc3e8e4 with identifier: 1981428
2026-03-24 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 017c24e7-23a7-5425-9cb6-941b0cc3e8e4 with identifier: 1981428
2026-03-24 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 017c24e7-23a7-5425-9cb6-941b0cc3e8e4 with identifier: 1981428 to the API
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/000/e755f43c8af14c50bc28172132b78e9e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '017c24e7-23a7-5425-9cb6-941b0cc3e8e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 100994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017c24e7-23a7-5425-9cb6-941b0cc3e8e4/017c24e7-23a7-5425-9cb6-941b0cc3e8e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/000/e755f43c8af14c50bc28172132b78e9e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981428%27 HTTP/1.1" 200 None
2026-03-24 18:33:38 [ayvens.es] INFO: Saving data for 1981428: {'created_time': 1774377218.328547, 'last_price_update_time': 1774377218.328556, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981428') HTTP/1.1" 204 0
2026-03-24 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e2f301ce-c7c2-504e-98c7-8e4639e18275 with identifier: 1981427
2026-03-24 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e2f301ce-c7c2-504e-98c7-8e4639e18275 with identifier: 1981427
2026-03-24 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e2f301ce-c7c2-504e-98c7-8e4639e18275 with identifier: 1981427 to the API
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/514/bac680eae6f64430b1fbfca51f2b002c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e2f301ce-c7c2-504e-98c7-8e4639e18275',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 106025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f301ce-c7c2-504e-98c7-8e4639e18275/e2f301ce-c7c2-504e-98c7-8e4639e18275_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/514/bac680eae6f64430b1fbfca51f2b002c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI 110kW (150CV) DSG ACT Ambition',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW (150CV) DSG ACT Ambition',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981427%27 HTTP/1.1" 200 None
2026-03-24 18:33:38 [ayvens.es] INFO: Saving data for 1981427: {'created_time': 1774377218.611629, 'last_price_update_time': 1774377218.611642, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981427') HTTP/1.1" 204 0
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee92e7d0>
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d2db69-988e-50e7-9428-4bea66fb2b7e/34d2db69-988e-50e7-9428-4bea66fb2b7e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252F6f38743fc41c452087d68e82ac010845%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/6f38743fc41c452087d68e82ac010845/images/large/1.jpg saved to cache
2026-03-24 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34d2db69-988e-50e7-9428-4bea66fb2b7e
2026-03-24 18:33:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34d2db69-988e-50e7-9428-4bea66fb2b7e, skipping ID generation
2026-03-24 18:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d2db69-988e-50e7-9428-4bea66fb2b7e with scrape type 1
2026-03-24 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34d2db69-988e-50e7-9428-4bea66fb2b7e sending to next pipeline
2026-03-24 18:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 34d2db69-988e-50e7-9428-4bea66fb2b7e, identifier: 1981429
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1dff10>
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0bda4f6-bd46-50c1-b94a-029eaffc9124/f0bda4f6-bd46-50c1-b94a-029eaffc9124_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F815%252F4a9f4153b4bf4617a99b5e56deae8d78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/815/4a9f4153b4bf4617a99b5e56deae8d78/images/large/1.jpg saved to cache
2026-03-24 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0bda4f6-bd46-50c1-b94a-029eaffc9124
2026-03-24 18:33:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0bda4f6-bd46-50c1-b94a-029eaffc9124, skipping ID generation
2026-03-24 18:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bda4f6-bd46-50c1-b94a-029eaffc9124 with scrape type 1
2026-03-24 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0bda4f6-bd46-50c1-b94a-029eaffc9124 sending to next pipeline
2026-03-24 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f0bda4f6-bd46-50c1-b94a-029eaffc9124, identifier: 1981430
2026-03-24 18:33:39 [ayvens.es] INFO: Found listing with ID: 1981438
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981438%27 HTTP/1.1" 200 None
2026-03-24 18:33:39 [ayvens.es] INFO: Scrape type for 1981438: 1
2026-03-24 18:33:39 [ayvens.es] INFO: Extracting data for car ID: 1981438
2026-03-24 18:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48913a16-4c6d-544e-8d50-9ae602a21dcb with identifier: 1981438
2026-03-24 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48913a16-4c6d-544e-8d50-9ae602a21dcb with scrape type 1
2026-03-24 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48913a16-4c6d-544e-8d50-9ae602a21dcb
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F660%252F60b0bbbd1cd84d2e8d4530c9e6555f3b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/660/60b0bbbd1cd84d2e8d4530c9e6555f3b/images/large/1.jpg not downloaded yet
2026-03-24 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 34d2db69-988e-50e7-9428-4bea66fb2b7e with identifier: 1981429
2026-03-24 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 34d2db69-988e-50e7-9428-4bea66fb2b7e with identifier: 1981429
2026-03-24 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 34d2db69-988e-50e7-9428-4bea66fb2b7e with identifier: 1981429 to the API
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/382/6f38743fc41c452087d68e82ac010845/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '34d2db69-988e-50e7-9428-4bea66fb2b7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 131615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d2db69-988e-50e7-9428-4bea66fb2b7e/34d2db69-988e-50e7-9428-4bea66fb2b7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/382/6f38743fc41c452087d68e82ac010845/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2018}
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981429%27 HTTP/1.1" 200 None
2026-03-24 18:33:39 [ayvens.es] INFO: Saving data for 1981429: {'created_time': 1774377219.361449, 'last_price_update_time': 1774377219.36146, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981429') HTTP/1.1" 204 0
2026-03-24 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f0bda4f6-bd46-50c1-b94a-029eaffc9124 with identifier: 1981430
2026-03-24 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f0bda4f6-bd46-50c1-b94a-029eaffc9124 with identifier: 1981430
2026-03-24 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f0bda4f6-bd46-50c1-b94a-029eaffc9124 with identifier: 1981430 to the API
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/815/4a9f4153b4bf4617a99b5e56deae8d78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f0bda4f6-bd46-50c1-b94a-029eaffc9124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 63289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0bda4f6-bd46-50c1-b94a-029eaffc9124/f0bda4f6-bd46-50c1-b94a-029eaffc9124_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/815/4a9f4153b4bf4617a99b5e56deae8d78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 85kW (115CV) - 18',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 85kW (115CV) - 18',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981430%27 HTTP/1.1" 200 None
2026-03-24 18:33:39 [ayvens.es] INFO: Saving data for 1981430: {'created_time': 1774377219.641217, 'last_price_update_time': 1774377219.641232, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981430') HTTP/1.1" 204 0
2026-03-24 18:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/029/6b9dc2ac4ad342ad9dab03aa032891ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea08750>
2026-03-24 18:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c95201-5a15-5135-8b28-8928b98650ff/b6c95201-5a15-5135-8b28-8928b98650ff_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252Fc19122188bad4fe481fbc01a6536d89f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/c19122188bad4fe481fbc01a6536d89f/images/large/1.jpg saved to cache
2026-03-24 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6c95201-5a15-5135-8b28-8928b98650ff
2026-03-24 18:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6c95201-5a15-5135-8b28-8928b98650ff, skipping ID generation
2026-03-24 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c95201-5a15-5135-8b28-8928b98650ff with scrape type 1
2026-03-24 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6c95201-5a15-5135-8b28-8928b98650ff sending to next pipeline
2026-03-24 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b6c95201-5a15-5135-8b28-8928b98650ff, identifier: 1981431
2026-03-24 18:33:39 [ayvens.es] INFO: Found listing with ID: 1981439
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981439%27 HTTP/1.1" 200 None
2026-03-24 18:33:39 [ayvens.es] INFO: Scrape type for 1981439: 1
2026-03-24 18:33:39 [ayvens.es] INFO: Extracting data for car ID: 1981439
2026-03-24 18:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c60426c7-9692-522f-9f6f-788ec75e88c6 with identifier: 1981439
2026-03-24 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60426c7-9692-522f-9f6f-788ec75e88c6 with scrape type 1
2026-03-24 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c60426c7-9692-522f-9f6f-788ec75e88c6
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F367%252F2794af735b7d4fa0966d167234b2cf9a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/367/2794af735b7d4fa0966d167234b2cf9a/images/large/1.jpg not downloaded yet
2026-03-24 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b6c95201-5a15-5135-8b28-8928b98650ff with identifier: 1981431
2026-03-24 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b6c95201-5a15-5135-8b28-8928b98650ff with identifier: 1981431
2026-03-24 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b6c95201-5a15-5135-8b28-8928b98650ff with identifier: 1981431 to the API
2026-03-24 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/422/c19122188bad4fe481fbc01a6536d89f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b6c95201-5a15-5135-8b28-8928b98650ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 125261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c95201-5a15-5135-8b28-8928b98650ff/b6c95201-5a15-5135-8b28-8928b98650ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/422/c19122188bad4fe481fbc01a6536d89f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER Allure Pack Long BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Allure Pack Long BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981431%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [ayvens.es] INFO: Saving data for 1981431: {'created_time': 1774377220.194918, 'last_price_update_time': 1774377220.19493, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981431') HTTP/1.1" 204 0
2026-03-24 18:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/622/c9ca9ec43c3c472886590d9a69eb5292/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:40 [ayvens.es] INFO: Found listing with ID: 1981440
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981440%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [ayvens.es] INFO: Scrape type for 1981440: 1
2026-03-24 18:33:40 [ayvens.es] INFO: Extracting data for car ID: 1981440
2026-03-24 18:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5510ce72-19f9-5409-b2be-d09d14cf18fa with identifier: 1981440
2026-03-24 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5510ce72-19f9-5409-b2be-d09d14cf18fa with scrape type 1
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5510ce72-19f9-5409-b2be-d09d14cf18fa
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F7a1809f926e94f78946c1fe6fbcb3ce4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/7a1809f926e94f78946c1fe6fbcb3ce4/images/large/1.jpg not downloaded yet
2026-03-24 18:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/020/278cf8c1d2c94803a32fac736f63c03e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed35e10>
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1d2459-98a4-52a9-88a3-b1757c62f8d1/0b1d2459-98a4-52a9-88a3-b1757c62f8d1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F6b9dc2ac4ad342ad9dab03aa032891ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/6b9dc2ac4ad342ad9dab03aa032891ba/images/large/1.jpg saved to cache
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b1d2459-98a4-52a9-88a3-b1757c62f8d1
2026-03-24 18:33:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b1d2459-98a4-52a9-88a3-b1757c62f8d1, skipping ID generation
2026-03-24 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1d2459-98a4-52a9-88a3-b1757c62f8d1 with scrape type 1
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b1d2459-98a4-52a9-88a3-b1757c62f8d1 sending to next pipeline
2026-03-24 18:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0b1d2459-98a4-52a9-88a3-b1757c62f8d1, identifier: 1981433
2026-03-24 18:33:40 [ayvens.es] INFO: Found listing with ID: 1981441
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981441%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [ayvens.es] INFO: Scrape type for 1981441: 1
2026-03-24 18:33:40 [ayvens.es] INFO: Extracting data for car ID: 1981441
2026-03-24 18:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1981441
2026-03-24 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a55ee-bcc2-5541-8388-5fcb9c032098 with scrape type 1
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c99a55ee-bcc2-5541-8388-5fcb9c032098
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F843%252F9c6b34b8a7ac4b86a710f53319a14f59%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/843/9c6b34b8a7ac4b86a710f53319a14f59/images/large/1.jpg not downloaded yet
2026-03-24 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0b1d2459-98a4-52a9-88a3-b1757c62f8d1 with identifier: 1981433
2026-03-24 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0b1d2459-98a4-52a9-88a3-b1757c62f8d1 with identifier: 1981433
2026-03-24 18:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0b1d2459-98a4-52a9-88a3-b1757c62f8d1 with identifier: 1981433 to the API
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/029/6b9dc2ac4ad342ad9dab03aa032891ba/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco luna',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0b1d2459-98a4-52a9-88a3-b1757c62f8d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 190555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1d2459-98a4-52a9-88a3-b1757c62f8d1/0b1d2459-98a4-52a9-88a3-b1757c62f8d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/029/6b9dc2ac4ad342ad9dab03aa032891ba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA Combi 2.0 TDI 85kW(115CV) Man Ambition',
 'transmission': 'manual',
 'trim': 'Combi 2.0 TDI 85kW(115CV) Man Ambition',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981433%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [ayvens.es] INFO: Saving data for 1981433: {'created_time': 1774377220.790289, 'last_price_update_time': 1774377220.790301, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981433') HTTP/1.1" 204 0
2026-03-24 18:33:40 [ayvens.es] INFO: Found listing with ID: 1981442
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981442%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [ayvens.es] INFO: Scrape type for 1981442: 1
2026-03-24 18:33:40 [ayvens.es] INFO: Extracting data for car ID: 1981442
2026-03-24 18:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1da5816-f503-5a2d-8087-a6bac9209f62 with identifier: 1981442
2026-03-24 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1da5816-f503-5a2d-8087-a6bac9209f62 with scrape type 1
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1da5816-f503-5a2d-8087-a6bac9209f62
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252Fe3c96ed9732041bcaf9eeffff9c5170f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/e3c96ed9732041bcaf9eeffff9c5170f/images/large/1.jpg not downloaded yet
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee225dd0>
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_618c0ea4-a56e-5257-9958-d986ff2450a9/618c0ea4-a56e-5257-9958-d986ff2450a9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F622%252Fc9ca9ec43c3c472886590d9a69eb5292%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/622/c9ca9ec43c3c472886590d9a69eb5292/images/large/1.jpg saved to cache
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 618c0ea4-a56e-5257-9958-d986ff2450a9
2026-03-24 18:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 618c0ea4-a56e-5257-9958-d986ff2450a9, skipping ID generation
2026-03-24 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 618c0ea4-a56e-5257-9958-d986ff2450a9 with scrape type 1
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 618c0ea4-a56e-5257-9958-d986ff2450a9 sending to next pipeline
2026-03-24 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 618c0ea4-a56e-5257-9958-d986ff2450a9, identifier: 1981432
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1cb210>
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58853889-c8b8-57ca-a581-49e70dc042c6/58853889-c8b8-57ca-a581-49e70dc042c6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252F278cf8c1d2c94803a32fac736f63c03e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/278cf8c1d2c94803a32fac736f63c03e/images/large/1.jpg saved to cache
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58853889-c8b8-57ca-a581-49e70dc042c6
2026-03-24 18:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58853889-c8b8-57ca-a581-49e70dc042c6, skipping ID generation
2026-03-24 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58853889-c8b8-57ca-a581-49e70dc042c6 with scrape type 1
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58853889-c8b8-57ca-a581-49e70dc042c6 sending to next pipeline
2026-03-24 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 58853889-c8b8-57ca-a581-49e70dc042c6, identifier: 1981434
2026-03-24 18:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/057/17ed194f41e84a02a2a972e833a14f32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 618c0ea4-a56e-5257-9958-d986ff2450a9 with identifier: 1981432
2026-03-24 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 618c0ea4-a56e-5257-9958-d986ff2450a9 with identifier: 1981432
2026-03-24 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 618c0ea4-a56e-5257-9958-d986ff2450a9 with identifier: 1981432 to the API
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/622/c9ca9ec43c3c472886590d9a69eb5292/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '618c0ea4-a56e-5257-9958-d986ff2450a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 187123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_618c0ea4-a56e-5257-9958-d986ff2450a9/618c0ea4-a56e-5257-9958-d986ff2450a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/622/c9ca9ec43c3c472886590d9a69eb5292/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Advance 2.0 TDI 110kW (150CV) Variant',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) Variant',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981432%27 HTTP/1.1" 200 None
2026-03-24 18:33:41 [ayvens.es] INFO: Saving data for 1981432: {'created_time': 1774377221.560426, 'last_price_update_time': 1774377221.560436, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981432') HTTP/1.1" 204 0
2026-03-24 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 58853889-c8b8-57ca-a581-49e70dc042c6 with identifier: 1981434
2026-03-24 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 58853889-c8b8-57ca-a581-49e70dc042c6 with identifier: 1981434
2026-03-24 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 58853889-c8b8-57ca-a581-49e70dc042c6 with identifier: 1981434 to the API
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/020/278cf8c1d2c94803a32fac736f63c03e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '58853889-c8b8-57ca-a581-49e70dc042c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 45327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58853889-c8b8-57ca-a581-49e70dc042c6/58853889-c8b8-57ca-a581-49e70dc042c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/278cf8c1d2c94803a32fac736f63c03e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981434%27 HTTP/1.1" 200 None
2026-03-24 18:33:41 [ayvens.es] INFO: Saving data for 1981434: {'created_time': 1774377221.852404, 'last_price_update_time': 1774377221.852414, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981434') HTTP/1.1" 204 0
2026-03-24 18:33:41 [ayvens.es] INFO: Found listing with ID: 1981443
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981443%27 HTTP/1.1" 200 None
2026-03-24 18:33:41 [ayvens.es] INFO: Scrape type for 1981443: 1
2026-03-24 18:33:41 [ayvens.es] INFO: Extracting data for car ID: 1981443
2026-03-24 18:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0af288b-9244-56df-bb5a-715722647ae5 with identifier: 1981443
2026-03-24 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0af288b-9244-56df-bb5a-715722647ae5 with scrape type 1
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c0af288b-9244-56df-bb5a-715722647ae5
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F464%252Fe75684d6946949c49e52d2fa22c8ce68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/464/e75684d6946949c49e52d2fa22c8ce68/images/large/1.jpg not downloaded yet
2026-03-24 18:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/091/d90c17993e8840fc84508638162a8094/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:41 [ayvens.es] INFO: Found listing with ID: 1981444
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981444%27 HTTP/1.1" 200 None
2026-03-24 18:33:41 [ayvens.es] INFO: Scrape type for 1981444: 1
2026-03-24 18:33:41 [ayvens.es] INFO: Extracting data for car ID: 1981444
2026-03-24 18:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1981444
2026-03-24 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41d825d-8617-5875-afe1-3c8c529cb3ec with scrape type 1
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e41d825d-8617-5875-afe1-3c8c529cb3ec
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252F073dc3cf1c7a4aa39a8136d66681b9da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/073dc3cf1c7a4aa39a8136d66681b9da/images/large/1.jpg not downloaded yet
2026-03-24 18:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/660/60b0bbbd1cd84d2e8d4530c9e6555f3b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6c7390>
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cece9be-6047-5c2e-b42a-ddddf8acd56f/5cece9be-6047-5c2e-b42a-ddddf8acd56f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F17ed194f41e84a02a2a972e833a14f32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/17ed194f41e84a02a2a972e833a14f32/images/large/1.jpg saved to cache
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f
2026-03-24 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cece9be-6047-5c2e-b42a-ddddf8acd56f, skipping ID generation
2026-03-24 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f with scrape type 1
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f sending to next pipeline
2026-03-24 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5cece9be-6047-5c2e-b42a-ddddf8acd56f, identifier: 1981435
2026-03-24 18:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/367/2794af735b7d4fa0966d167234b2cf9a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:42 [ayvens.es] INFO: Found listing with ID: 1981445
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981445%27 HTTP/1.1" 200 None
2026-03-24 18:33:42 [ayvens.es] INFO: Scrape type for 1981445: 1
2026-03-24 18:33:42 [ayvens.es] INFO: Extracting data for car ID: 1981445
2026-03-24 18:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6499a090-02d1-5ac0-926a-30f1becc9564 with identifier: 1981445
2026-03-24 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6499a090-02d1-5ac0-926a-30f1becc9564 with scrape type 1
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6499a090-02d1-5ac0-926a-30f1becc9564
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252Fead21b6a1cc3422888fb470cdb3237e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/ead21b6a1cc3422888fb470cdb3237e2/images/large/1.jpg not downloaded yet
2026-03-24 18:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1981435
2026-03-24 18:33:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1981435
2026-03-24 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1981435 to the API
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/057/17ed194f41e84a02a2a972e833a14f32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata pirita metaliz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5cece9be-6047-5c2e-b42a-ddddf8acd56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 86693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cece9be-6047-5c2e-b42a-ddddf8acd56f/5cece9be-6047-5c2e-b42a-ddddf8acd56f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/057/17ed194f41e84a02a2a972e833a14f32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981435%27 HTTP/1.1" 200 None
2026-03-24 18:33:42 [ayvens.es] INFO: Saving data for 1981435: {'created_time': 1774377222.473503, 'last_price_update_time': 1774377222.473513, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981435') HTTP/1.1" 204 0
2026-03-24 18:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/061/7a1809f926e94f78946c1fe6fbcb3ce4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:42 [ayvens.es] INFO: Found listing with ID: 1981446
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981446%27 HTTP/1.1" 200 None
2026-03-24 18:33:42 [ayvens.es] INFO: Scrape type for 1981446: 1
2026-03-24 18:33:42 [ayvens.es] INFO: Extracting data for car ID: 1981446
2026-03-24 18:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f272915-6bc3-54f1-b84b-bf780ea21541 with identifier: 1981446
2026-03-24 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f272915-6bc3-54f1-b84b-bf780ea21541 with scrape type 1
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2f272915-6bc3-54f1-b84b-bf780ea21541
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F727%252F3158c2334793436e95290155bd8f3e92%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/727/3158c2334793436e95290155bd8f3e92/images/large/1.jpg not downloaded yet
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb0aed0>
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35705818-60a6-5729-95b3-94a5b53e2ba7/35705818-60a6-5729-95b3-94a5b53e2ba7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F091%252Fd90c17993e8840fc84508638162a8094%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/091/d90c17993e8840fc84508638162a8094/images/large/1.jpg saved to cache
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35705818-60a6-5729-95b3-94a5b53e2ba7
2026-03-24 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35705818-60a6-5729-95b3-94a5b53e2ba7, skipping ID generation
2026-03-24 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35705818-60a6-5729-95b3-94a5b53e2ba7 with scrape type 1
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35705818-60a6-5729-95b3-94a5b53e2ba7 sending to next pipeline
2026-03-24 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35705818-60a6-5729-95b3-94a5b53e2ba7, identifier: 1981437
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee936710>
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48913a16-4c6d-544e-8d50-9ae602a21dcb/48913a16-4c6d-544e-8d50-9ae602a21dcb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F660%252F60b0bbbd1cd84d2e8d4530c9e6555f3b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/660/60b0bbbd1cd84d2e8d4530c9e6555f3b/images/large/1.jpg saved to cache
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48913a16-4c6d-544e-8d50-9ae602a21dcb
2026-03-24 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48913a16-4c6d-544e-8d50-9ae602a21dcb, skipping ID generation
2026-03-24 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48913a16-4c6d-544e-8d50-9ae602a21dcb with scrape type 1
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48913a16-4c6d-544e-8d50-9ae602a21dcb sending to next pipeline
2026-03-24 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 48913a16-4c6d-544e-8d50-9ae602a21dcb, identifier: 1981438
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6b5410>
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60426c7-9692-522f-9f6f-788ec75e88c6/c60426c7-9692-522f-9f6f-788ec75e88c6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F367%252F2794af735b7d4fa0966d167234b2cf9a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/367/2794af735b7d4fa0966d167234b2cf9a/images/large/1.jpg saved to cache
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c60426c7-9692-522f-9f6f-788ec75e88c6
2026-03-24 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c60426c7-9692-522f-9f6f-788ec75e88c6, skipping ID generation
2026-03-24 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60426c7-9692-522f-9f6f-788ec75e88c6 with scrape type 1
2026-03-24 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c60426c7-9692-522f-9f6f-788ec75e88c6 sending to next pipeline
2026-03-24 18:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c60426c7-9692-522f-9f6f-788ec75e88c6, identifier: 1981439
2026-03-24 18:33:43 [ayvens.es] INFO: Found listing with ID: 1981447
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981447%27 HTTP/1.1" 200 None
2026-03-24 18:33:43 [ayvens.es] INFO: Scrape type for 1981447: 1
2026-03-24 18:33:43 [ayvens.es] INFO: Extracting data for car ID: 1981447
2026-03-24 18:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 987ba34d-6126-540e-ba50-9ce2088f3f60 with identifier: 1981447
2026-03-24 18:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 987ba34d-6126-540e-ba50-9ce2088f3f60 with scrape type 1
2026-03-24 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 987ba34d-6126-540e-ba50-9ce2088f3f60
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252Ff921e55ca8a1457389872b4f04dcd75b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/f921e55ca8a1457389872b4f04dcd75b/images/large/1.jpg not downloaded yet
2026-03-24 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1981437
2026-03-24 18:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1981437
2026-03-24 18:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1981437 to the API
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/091/d90c17993e8840fc84508638162a8094/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '35705818-60a6-5729-95b3-94a5b53e2ba7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 152228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35705818-60a6-5729-95b3-94a5b53e2ba7/35705818-60a6-5729-95b3-94a5b53e2ba7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/091/d90c17993e8840fc84508638162a8094/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Intens Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Intens Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981437%27 HTTP/1.1" 200 None
2026-03-24 18:33:43 [ayvens.es] INFO: Saving data for 1981437: {'created_time': 1774377223.308027, 'last_price_update_time': 1774377223.308038, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981437') HTTP/1.1" 204 0
2026-03-24 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 48913a16-4c6d-544e-8d50-9ae602a21dcb with identifier: 1981438
2026-03-24 18:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 48913a16-4c6d-544e-8d50-9ae602a21dcb with identifier: 1981438
2026-03-24 18:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 48913a16-4c6d-544e-8d50-9ae602a21dcb with identifier: 1981438 to the API
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/660/60b0bbbd1cd84d2e8d4530c9e6555f3b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '48913a16-4c6d-544e-8d50-9ae602a21dcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 62642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48913a16-4c6d-544e-8d50-9ae602a21dcb/48913a16-4c6d-544e-8d50-9ae602a21dcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/660/60b0bbbd1cd84d2e8d4530c9e6555f3b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981438%27 HTTP/1.1" 200 None
2026-03-24 18:33:43 [ayvens.es] INFO: Saving data for 1981438: {'created_time': 1774377223.596024, 'last_price_update_time': 1774377223.596033, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981438') HTTP/1.1" 204 0
2026-03-24 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c60426c7-9692-522f-9f6f-788ec75e88c6 with identifier: 1981439
2026-03-24 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c60426c7-9692-522f-9f6f-788ec75e88c6 with identifier: 1981439
2026-03-24 18:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c60426c7-9692-522f-9f6f-788ec75e88c6 with identifier: 1981439 to the API
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/367/2794af735b7d4fa0966d167234b2cf9a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Plata claro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c60426c7-9692-522f-9f6f-788ec75e88c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 71082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60426c7-9692-522f-9f6f-788ec75e88c6/c60426c7-9692-522f-9f6f-788ec75e88c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/367/2794af735b7d4fa0966d167234b2cf9a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981439%27 HTTP/1.1" 200 None
2026-03-24 18:33:43 [ayvens.es] INFO: Saving data for 1981439: {'created_time': 1774377223.877083, 'last_price_update_time': 1774377223.877092, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981439') HTTP/1.1" 204 0
2026-03-24 18:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/843/9c6b34b8a7ac4b86a710f53319a14f59/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/935/e3c96ed9732041bcaf9eeffff9c5170f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:43 [ayvens.es] INFO: Found listing with ID: 1981448
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981448%27 HTTP/1.1" 200 None
2026-03-24 18:33:43 [ayvens.es] INFO: Scrape type for 1981448: 1
2026-03-24 18:33:43 [ayvens.es] INFO: Extracting data for car ID: 1981448
2026-03-24 18:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1981448
2026-03-24 18:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee040410-ebc4-5963-b54b-825b669082e2 with scrape type 1
2026-03-24 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee040410-ebc4-5963-b54b-825b669082e2
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252F311a195908a34fa990e8cc66cab68dae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/311a195908a34fa990e8cc66cab68dae/images/large/1.jpg not downloaded yet
2026-03-24 18:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/464/e75684d6946949c49e52d2fa22c8ce68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7cf0d0>
2026-03-24 18:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5510ce72-19f9-5409-b2be-d09d14cf18fa/5510ce72-19f9-5409-b2be-d09d14cf18fa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F7a1809f926e94f78946c1fe6fbcb3ce4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/7a1809f926e94f78946c1fe6fbcb3ce4/images/large/1.jpg saved to cache
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5510ce72-19f9-5409-b2be-d09d14cf18fa
2026-03-24 18:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5510ce72-19f9-5409-b2be-d09d14cf18fa, skipping ID generation
2026-03-24 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5510ce72-19f9-5409-b2be-d09d14cf18fa with scrape type 1
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5510ce72-19f9-5409-b2be-d09d14cf18fa sending to next pipeline
2026-03-24 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5510ce72-19f9-5409-b2be-d09d14cf18fa, identifier: 1981440
2026-03-24 18:33:44 [ayvens.es] INFO: Found listing with ID: 1981449
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981449%27 HTTP/1.1" 200 None
2026-03-24 18:33:44 [ayvens.es] INFO: Scrape type for 1981449: 1
2026-03-24 18:33:44 [ayvens.es] INFO: Extracting data for car ID: 1981449
2026-03-24 18:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1981449
2026-03-24 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 847b96a4-1246-5d72-b440-338ad21be5cd with scrape type 1
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 847b96a4-1246-5d72-b440-338ad21be5cd
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252Fbd99b6acb3ea4c2095724820b4157c64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/bd99b6acb3ea4c2095724820b4157c64/images/large/1.jpg not downloaded yet
2026-03-24 18:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5510ce72-19f9-5409-b2be-d09d14cf18fa with identifier: 1981440
2026-03-24 18:33:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5510ce72-19f9-5409-b2be-d09d14cf18fa with identifier: 1981440
2026-03-24 18:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5510ce72-19f9-5409-b2be-d09d14cf18fa with identifier: 1981440 to the API
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/061/7a1809f926e94f78946c1fe6fbcb3ce4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Azul atl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5510ce72-19f9-5409-b2be-d09d14cf18fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 43484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5510ce72-19f9-5409-b2be-d09d14cf18fa/5510ce72-19f9-5409-b2be-d09d14cf18fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/061/7a1809f926e94f78946c1fe6fbcb3ce4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981440%27 HTTP/1.1" 200 None
2026-03-24 18:33:44 [ayvens.es] INFO: Saving data for 1981440: {'created_time': 1774377224.4178, 'last_price_update_time': 1774377224.417811, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981440') HTTP/1.1" 204 0
2026-03-24 18:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/611/073dc3cf1c7a4aa39a8136d66681b9da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:44 [ayvens.es] INFO: Found listing with ID: 1981450
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981450%27 HTTP/1.1" 200 None
2026-03-24 18:33:44 [ayvens.es] INFO: Scrape type for 1981450: 1
2026-03-24 18:33:44 [ayvens.es] INFO: Extracting data for car ID: 1981450
2026-03-24 18:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d1d63ed-bc66-5332-b773-67638252ced1 with identifier: 1981450
2026-03-24 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d1d63ed-bc66-5332-b773-67638252ced1 with scrape type 1
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0d1d63ed-bc66-5332-b773-67638252ced1
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F8a0da4e57ecd416b803523d7cf41f4c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/8a0da4e57ecd416b803523d7cf41f4c2/images/large/1.jpg not downloaded yet
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee92dd10>
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a55ee-bcc2-5541-8388-5fcb9c032098/c99a55ee-bcc2-5541-8388-5fcb9c032098_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F843%252F9c6b34b8a7ac4b86a710f53319a14f59%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/843/9c6b34b8a7ac4b86a710f53319a14f59/images/large/1.jpg saved to cache
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c99a55ee-bcc2-5541-8388-5fcb9c032098
2026-03-24 18:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c99a55ee-bcc2-5541-8388-5fcb9c032098, skipping ID generation
2026-03-24 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a55ee-bcc2-5541-8388-5fcb9c032098 with scrape type 1
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c99a55ee-bcc2-5541-8388-5fcb9c032098 sending to next pipeline
2026-03-24 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c99a55ee-bcc2-5541-8388-5fcb9c032098, identifier: 1981441
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6f6510>
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1da5816-f503-5a2d-8087-a6bac9209f62/c1da5816-f503-5a2d-8087-a6bac9209f62_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252Fe3c96ed9732041bcaf9eeffff9c5170f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/e3c96ed9732041bcaf9eeffff9c5170f/images/large/1.jpg saved to cache
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1da5816-f503-5a2d-8087-a6bac9209f62
2026-03-24 18:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1da5816-f503-5a2d-8087-a6bac9209f62, skipping ID generation
2026-03-24 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1da5816-f503-5a2d-8087-a6bac9209f62 with scrape type 1
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1da5816-f503-5a2d-8087-a6bac9209f62 sending to next pipeline
2026-03-24 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c1da5816-f503-5a2d-8087-a6bac9209f62, identifier: 1981442
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f9390>
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0af288b-9244-56df-bb5a-715722647ae5/c0af288b-9244-56df-bb5a-715722647ae5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F464%252Fe75684d6946949c49e52d2fa22c8ce68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/464/e75684d6946949c49e52d2fa22c8ce68/images/large/1.jpg saved to cache
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0af288b-9244-56df-bb5a-715722647ae5
2026-03-24 18:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0af288b-9244-56df-bb5a-715722647ae5, skipping ID generation
2026-03-24 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0af288b-9244-56df-bb5a-715722647ae5 with scrape type 1
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0af288b-9244-56df-bb5a-715722647ae5 sending to next pipeline
2026-03-24 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c0af288b-9244-56df-bb5a-715722647ae5, identifier: 1981443
2026-03-24 18:33:44 [ayvens.es] INFO: Found listing with ID: 1981451
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981451%27 HTTP/1.1" 200 None
2026-03-24 18:33:44 [ayvens.es] INFO: Scrape type for 1981451: 1
2026-03-24 18:33:44 [ayvens.es] INFO: Extracting data for car ID: 1981451
2026-03-24 18:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1981451
2026-03-24 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with scrape type 1
2026-03-24 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd
2026-03-24 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F9fc9bf043eaf4fe189c5fb9fdfea06f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/9fc9bf043eaf4fe189c5fb9fdfea06f8/images/large/1.jpg not downloaded yet
2026-03-24 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1981441
2026-03-24 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1981441
2026-03-24 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1981441 to the API
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/843/9c6b34b8a7ac4b86a710f53319a14f59/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Plata metalizada',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c99a55ee-bcc2-5541-8388-5fcb9c032098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 4359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a55ee-bcc2-5541-8388-5fcb9c032098/c99a55ee-bcc2-5541-8388-5fcb9c032098_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/843/9c6b34b8a7ac4b86a710f53319a14f59/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Advance 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981441%27 HTTP/1.1" 200 None
2026-03-24 18:33:45 [ayvens.es] INFO: Saving data for 1981441: {'created_time': 1774377225.348315, 'last_price_update_time': 1774377225.348331, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981441') HTTP/1.1" 204 0
2026-03-24 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c1da5816-f503-5a2d-8087-a6bac9209f62 with identifier: 1981442
2026-03-24 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c1da5816-f503-5a2d-8087-a6bac9209f62 with identifier: 1981442
2026-03-24 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c1da5816-f503-5a2d-8087-a6bac9209f62 with identifier: 1981442 to the API
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/935/e3c96ed9732041bcaf9eeffff9c5170f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata reflex',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c1da5816-f503-5a2d-8087-a6bac9209f62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 84782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1da5816-f503-5a2d-8087-a6bac9209f62/c1da5816-f503-5a2d-8087-a6bac9209f62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/935/e3c96ed9732041bcaf9eeffff9c5170f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981442%27 HTTP/1.1" 200 None
2026-03-24 18:33:45 [ayvens.es] INFO: Saving data for 1981442: {'created_time': 1774377225.66812, 'last_price_update_time': 1774377225.668131, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981442') HTTP/1.1" 204 0
2026-03-24 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c0af288b-9244-56df-bb5a-715722647ae5 with identifier: 1981443
2026-03-24 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c0af288b-9244-56df-bb5a-715722647ae5 with identifier: 1981443
2026-03-24 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c0af288b-9244-56df-bb5a-715722647ae5 with identifier: 1981443 to the API
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/464/e75684d6946949c49e52d2fa22c8ce68/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Plata reflex',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0af288b-9244-56df-bb5a-715722647ae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 142197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0af288b-9244-56df-bb5a-715722647ae5/c0af288b-9244-56df-bb5a-715722647ae5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/464/e75684d6946949c49e52d2fa22c8ce68/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981443%27 HTTP/1.1" 200 None
2026-03-24 18:33:45 [ayvens.es] INFO: Saving data for 1981443: {'created_time': 1774377225.935281, 'last_price_update_time': 1774377225.935291, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981443') HTTP/1.1" 204 0
2026-03-24 18:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/765/ead21b6a1cc3422888fb470cdb3237e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/727/3158c2334793436e95290155bd8f3e92/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:45 [ayvens.es] INFO: Found listing with ID: 1981452
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981452%27 HTTP/1.1" 200 None
2026-03-24 18:33:45 [ayvens.es] INFO: Scrape type for 1981452: 1
2026-03-24 18:33:45 [ayvens.es] INFO: Extracting data for car ID: 1981452
2026-03-24 18:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 715e1248-93c5-59c8-bdc8-879aab60af18 with identifier: 1981452
2026-03-24 18:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 715e1248-93c5-59c8-bdc8-879aab60af18 with scrape type 1
2026-03-24 18:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 715e1248-93c5-59c8-bdc8-879aab60af18
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252Fb4b1ded6a37a4ea2b80fdf857df6a294%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/b4b1ded6a37a4ea2b80fdf857df6a294/images/large/1.jpg not downloaded yet
2026-03-24 18:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed49910>
2026-03-24 18:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e41d825d-8617-5875-afe1-3c8c529cb3ec/e41d825d-8617-5875-afe1-3c8c529cb3ec_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252F073dc3cf1c7a4aa39a8136d66681b9da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/073dc3cf1c7a4aa39a8136d66681b9da/images/large/1.jpg saved to cache
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e41d825d-8617-5875-afe1-3c8c529cb3ec
2026-03-24 18:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e41d825d-8617-5875-afe1-3c8c529cb3ec, skipping ID generation
2026-03-24 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41d825d-8617-5875-afe1-3c8c529cb3ec with scrape type 1
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e41d825d-8617-5875-afe1-3c8c529cb3ec sending to next pipeline
2026-03-24 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e41d825d-8617-5875-afe1-3c8c529cb3ec, identifier: 1981444
2026-03-24 18:33:46 [ayvens.es] INFO: Found listing with ID: 1981453
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981453%27 HTTP/1.1" 200 None
2026-03-24 18:33:46 [ayvens.es] INFO: Scrape type for 1981453: 1
2026-03-24 18:33:46 [ayvens.es] INFO: Extracting data for car ID: 1981453
2026-03-24 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7cbdc45-0be0-5ffd-aea4-b20236a6b621 with identifier: 1981453
2026-03-24 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cbdc45-0be0-5ffd-aea4-b20236a6b621 with scrape type 1
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a7cbdc45-0be0-5ffd-aea4-b20236a6b621
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252Fa0539f84839c4019864ce34c5ae7c6cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/a0539f84839c4019864ce34c5ae7c6cb/images/large/1.jpg not downloaded yet
2026-03-24 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1981444
2026-03-24 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1981444
2026-03-24 18:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1981444 to the API
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/611/073dc3cf1c7a4aa39a8136d66681b9da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Plata pirita metaliz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e41d825d-8617-5875-afe1-3c8c529cb3ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 188790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e41d825d-8617-5875-afe1-3c8c529cb3ec/e41d825d-8617-5875-afe1-3c8c529cb3ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/611/073dc3cf1c7a4aa39a8136d66681b9da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981444%27 HTTP/1.1" 200 None
2026-03-24 18:33:46 [ayvens.es] INFO: Saving data for 1981444: {'created_time': 1774377226.478395, 'last_price_update_time': 1774377226.478405, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981444') HTTP/1.1" 204 0
2026-03-24 18:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/521/311a195908a34fa990e8cc66cab68dae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/645/f921e55ca8a1457389872b4f04dcd75b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:46 [ayvens.es] INFO: Found listing with ID: 1981454
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981454%27 HTTP/1.1" 200 None
2026-03-24 18:33:46 [ayvens.es] INFO: Scrape type for 1981454: 1
2026-03-24 18:33:46 [ayvens.es] INFO: Extracting data for car ID: 1981454
2026-03-24 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1981454
2026-03-24 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with scrape type 1
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F053%252Fe9b60874955c4693ad0d49404c466ce5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/053/e9b60874955c4693ad0d49404c466ce5/images/large/1.jpg not downloaded yet
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee82a290>
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6499a090-02d1-5ac0-926a-30f1becc9564/6499a090-02d1-5ac0-926a-30f1becc9564_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252Fead21b6a1cc3422888fb470cdb3237e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/ead21b6a1cc3422888fb470cdb3237e2/images/large/1.jpg saved to cache
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6499a090-02d1-5ac0-926a-30f1becc9564
2026-03-24 18:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6499a090-02d1-5ac0-926a-30f1becc9564, skipping ID generation
2026-03-24 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6499a090-02d1-5ac0-926a-30f1becc9564 with scrape type 1
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6499a090-02d1-5ac0-926a-30f1becc9564 sending to next pipeline
2026-03-24 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6499a090-02d1-5ac0-926a-30f1becc9564, identifier: 1981445
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee230310>
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f272915-6bc3-54f1-b84b-bf780ea21541/2f272915-6bc3-54f1-b84b-bf780ea21541_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F727%252F3158c2334793436e95290155bd8f3e92%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/727/3158c2334793436e95290155bd8f3e92/images/large/1.jpg saved to cache
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f272915-6bc3-54f1-b84b-bf780ea21541
2026-03-24 18:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f272915-6bc3-54f1-b84b-bf780ea21541, skipping ID generation
2026-03-24 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f272915-6bc3-54f1-b84b-bf780ea21541 with scrape type 1
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f272915-6bc3-54f1-b84b-bf780ea21541 sending to next pipeline
2026-03-24 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2f272915-6bc3-54f1-b84b-bf780ea21541, identifier: 1981446
2026-03-24 18:33:46 [ayvens.es] INFO: Found listing with ID: 1981455
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981455%27 HTTP/1.1" 200 None
2026-03-24 18:33:46 [ayvens.es] INFO: Scrape type for 1981455: 1
2026-03-24 18:33:46 [ayvens.es] INFO: Extracting data for car ID: 1981455
2026-03-24 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e with identifier: 1981455
2026-03-24 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e with scrape type 1
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F219%252Ff9d4b12adc57413dbc2e7b4912e129bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/219/f9d4b12adc57413dbc2e7b4912e129bb/images/large/1.jpg not downloaded yet
2026-03-24 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6499a090-02d1-5ac0-926a-30f1becc9564 with identifier: 1981445
2026-03-24 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6499a090-02d1-5ac0-926a-30f1becc9564 with identifier: 1981445
2026-03-24 18:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6499a090-02d1-5ac0-926a-30f1becc9564 with identifier: 1981445 to the API
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/765/ead21b6a1cc3422888fb470cdb3237e2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6499a090-02d1-5ac0-926a-30f1becc9564',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 200993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6499a090-02d1-5ac0-926a-30f1becc9564/6499a090-02d1-5ac0-926a-30f1becc9564_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/765/ead21b6a1cc3422888fb470cdb3237e2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Business & Navi 2.0 TDI 90kW (122CV)',
 'transmission': 'manual',
 'trim': 'Business & Navi 2.0 TDI 90kW (122CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981445%27 HTTP/1.1" 200 None
2026-03-24 18:33:47 [ayvens.es] INFO: Saving data for 1981445: {'created_time': 1774377227.749511, 'last_price_update_time': 1774377227.749522, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981445') HTTP/1.1" 204 0
2026-03-24 18:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2f272915-6bc3-54f1-b84b-bf780ea21541 with identifier: 1981446
2026-03-24 18:33:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2f272915-6bc3-54f1-b84b-bf780ea21541 with identifier: 1981446
2026-03-24 18:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2f272915-6bc3-54f1-b84b-bf780ea21541 with identifier: 1981446 to the API
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/727/3158c2334793436e95290155bd8f3e92/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2f272915-6bc3-54f1-b84b-bf780ea21541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 136547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f272915-6bc3-54f1-b84b-bf780ea21541/2f272915-6bc3-54f1-b84b-bf780ea21541_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/727/3158c2334793436e95290155bd8f3e92/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981446%27 HTTP/1.1" 200 None
2026-03-24 18:33:48 [ayvens.es] INFO: Saving data for 1981446: {'created_time': 1774377228.046165, 'last_price_update_time': 1774377228.046174, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981446') HTTP/1.1" 204 0
2026-03-24 18:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/943/bd99b6acb3ea4c2095724820b4157c64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/602/8a0da4e57ecd416b803523d7cf41f4c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:48 [ayvens.es] INFO: Found listing with ID: 1981456
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981456%27 HTTP/1.1" 200 None
2026-03-24 18:33:48 [ayvens.es] INFO: Scrape type for 1981456: 1
2026-03-24 18:33:48 [ayvens.es] INFO: Extracting data for car ID: 1981456
2026-03-24 18:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1981456
2026-03-24 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf64a30e-0d69-5994-9e23-41880ede47c5 with scrape type 1
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf64a30e-0d69-5994-9e23-41880ede47c5
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F517%252F1582ba35e9f84724853c69d8bea19535%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/517/1582ba35e9f84724853c69d8bea19535/images/large/1.jpg not downloaded yet
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9073d0>
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee040410-ebc4-5963-b54b-825b669082e2/ee040410-ebc4-5963-b54b-825b669082e2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252F311a195908a34fa990e8cc66cab68dae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/311a195908a34fa990e8cc66cab68dae/images/large/1.jpg saved to cache
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee040410-ebc4-5963-b54b-825b669082e2
2026-03-24 18:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee040410-ebc4-5963-b54b-825b669082e2, skipping ID generation
2026-03-24 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee040410-ebc4-5963-b54b-825b669082e2 with scrape type 1
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee040410-ebc4-5963-b54b-825b669082e2 sending to next pipeline
2026-03-24 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee040410-ebc4-5963-b54b-825b669082e2, identifier: 1981448
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1d6c50>
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_987ba34d-6126-540e-ba50-9ce2088f3f60/987ba34d-6126-540e-ba50-9ce2088f3f60_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252Ff921e55ca8a1457389872b4f04dcd75b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/f921e55ca8a1457389872b4f04dcd75b/images/large/1.jpg saved to cache
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 987ba34d-6126-540e-ba50-9ce2088f3f60
2026-03-24 18:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 987ba34d-6126-540e-ba50-9ce2088f3f60, skipping ID generation
2026-03-24 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 987ba34d-6126-540e-ba50-9ce2088f3f60 with scrape type 1
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 987ba34d-6126-540e-ba50-9ce2088f3f60 sending to next pipeline
2026-03-24 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 987ba34d-6126-540e-ba50-9ce2088f3f60, identifier: 1981447
2026-03-24 18:33:48 [ayvens.es] INFO: Found listing with ID: 1981457
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981457%27 HTTP/1.1" 200 None
2026-03-24 18:33:48 [ayvens.es] INFO: Scrape type for 1981457: 1
2026-03-24 18:33:48 [ayvens.es] INFO: Extracting data for car ID: 1981457
2026-03-24 18:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1981457
2026-03-24 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8843392-10fb-5ef7-92fa-010a4ce10933 with scrape type 1
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8843392-10fb-5ef7-92fa-010a4ce10933
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252Ff03af82dac05448392fc3110a33aa62e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/f03af82dac05448392fc3110a33aa62e/images/large/1.jpg not downloaded yet
2026-03-24 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1981448
2026-03-24 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1981448
2026-03-24 18:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1981448 to the API
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/521/311a195908a34fa990e8cc66cab68dae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ee040410-ebc4-5963-b54b-825b669082e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 84089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee040410-ebc4-5963-b54b-825b669082e2/ee040410-ebc4-5963-b54b-825b669082e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/521/311a195908a34fa990e8cc66cab68dae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981448%27 HTTP/1.1" 200 None
2026-03-24 18:33:48 [ayvens.es] INFO: Saving data for 1981448: {'created_time': 1774377228.738884, 'last_price_update_time': 1774377228.738894, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981448') HTTP/1.1" 204 0
2026-03-24 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 987ba34d-6126-540e-ba50-9ce2088f3f60 with identifier: 1981447
2026-03-24 18:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 987ba34d-6126-540e-ba50-9ce2088f3f60 with identifier: 1981447
2026-03-24 18:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 987ba34d-6126-540e-ba50-9ce2088f3f60 with identifier: 1981447 to the API
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/645/f921e55ca8a1457389872b4f04dcd75b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Plata claro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '987ba34d-6126-540e-ba50-9ce2088f3f60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 44297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_987ba34d-6126-540e-ba50-9ce2088f3f60/987ba34d-6126-540e-ba50-9ce2088f3f60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/645/f921e55ca8a1457389872b4f04dcd75b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance Style 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance Style 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981447%27 HTTP/1.1" 200 None
2026-03-24 18:33:49 [ayvens.es] INFO: Saving data for 1981447: {'created_time': 1774377229.031813, 'last_price_update_time': 1774377229.031823, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981447') HTTP/1.1" 204 0
2026-03-24 18:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/b4b1ded6a37a4ea2b80fdf857df6a294/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/753/9fc9bf043eaf4fe189c5fb9fdfea06f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:49 [ayvens.es] INFO: Found listing with ID: 1981458
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981458%27 HTTP/1.1" 200 None
2026-03-24 18:33:49 [ayvens.es] INFO: Scrape type for 1981458: 1
2026-03-24 18:33:49 [ayvens.es] INFO: Extracting data for car ID: 1981458
2026-03-24 18:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3b6f29-42d5-5ad6-95f6-322a61a8b030 with identifier: 1981458
2026-03-24 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3b6f29-42d5-5ad6-95f6-322a61a8b030 with scrape type 1
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6c3b6f29-42d5-5ad6-95f6-322a61a8b030
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252F18a552532ec0443998fbd1ff6c72bb1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/18a552532ec0443998fbd1ff6c72bb1a/images/large/1.jpg not downloaded yet
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0c1890>
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_847b96a4-1246-5d72-b440-338ad21be5cd/847b96a4-1246-5d72-b440-338ad21be5cd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252Fbd99b6acb3ea4c2095724820b4157c64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/bd99b6acb3ea4c2095724820b4157c64/images/large/1.jpg saved to cache
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 847b96a4-1246-5d72-b440-338ad21be5cd
2026-03-24 18:33:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 847b96a4-1246-5d72-b440-338ad21be5cd, skipping ID generation
2026-03-24 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 847b96a4-1246-5d72-b440-338ad21be5cd with scrape type 1
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 847b96a4-1246-5d72-b440-338ad21be5cd sending to next pipeline
2026-03-24 18:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 847b96a4-1246-5d72-b440-338ad21be5cd, identifier: 1981449
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0c1d10>
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1d63ed-bc66-5332-b773-67638252ced1/0d1d63ed-bc66-5332-b773-67638252ced1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F8a0da4e57ecd416b803523d7cf41f4c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/8a0da4e57ecd416b803523d7cf41f4c2/images/large/1.jpg saved to cache
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d1d63ed-bc66-5332-b773-67638252ced1
2026-03-24 18:33:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d1d63ed-bc66-5332-b773-67638252ced1, skipping ID generation
2026-03-24 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d1d63ed-bc66-5332-b773-67638252ced1 with scrape type 1
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d1d63ed-bc66-5332-b773-67638252ced1 sending to next pipeline
2026-03-24 18:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0d1d63ed-bc66-5332-b773-67638252ced1, identifier: 1981450
2026-03-24 18:33:49 [ayvens.es] INFO: Found listing with ID: 1981459
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981459%27 HTTP/1.1" 200 None
2026-03-24 18:33:49 [ayvens.es] INFO: Scrape type for 1981459: 1
2026-03-24 18:33:49 [ayvens.es] INFO: Extracting data for car ID: 1981459
2026-03-24 18:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d666b5f-9995-5d0d-87af-67bf916b04dd with identifier: 1981459
2026-03-24 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d666b5f-9995-5d0d-87af-67bf916b04dd with scrape type 1
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d666b5f-9995-5d0d-87af-67bf916b04dd
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F970%252Fb8657111531546159eaeb4851d87c18e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/970/b8657111531546159eaeb4851d87c18e/images/large/1.jpg not downloaded yet
2026-03-24 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1981449
2026-03-24 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1981449
2026-03-24 18:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1981449 to the API
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/943/bd99b6acb3ea4c2095724820b4157c64/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris casiopea',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '847b96a4-1246-5d72-b440-338ad21be5cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TALISMAN',
 'odometer': 184484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_847b96a4-1246-5d72-b440-338ad21be5cd/847b96a4-1246-5d72-b440-338ad21be5cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/943/bd99b6acb3ea4c2095724820b4157c64/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT TALISMAN S.T. Business Blue dCi 88 kW (120 CV)',
 'transmission': 'manual',
 'trim': 'S.T. Business Blue dCi 88 kW (120 CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981449%27 HTTP/1.1" 200 None
2026-03-24 18:33:49 [ayvens.es] INFO: Saving data for 1981449: {'created_time': 1774377229.819364, 'last_price_update_time': 1774377229.819375, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981449') HTTP/1.1" 204 0
2026-03-24 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0d1d63ed-bc66-5332-b773-67638252ced1 with identifier: 1981450
2026-03-24 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0d1d63ed-bc66-5332-b773-67638252ced1 with identifier: 1981450
2026-03-24 18:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0d1d63ed-bc66-5332-b773-67638252ced1 with identifier: 1981450 to the API
2026-03-24 18:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/602/8a0da4e57ecd416b803523d7cf41f4c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0d1d63ed-bc66-5332-b773-67638252ced1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 93132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1d63ed-bc66-5332-b773-67638252ced1/0d1d63ed-bc66-5332-b773-67638252ced1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/8a0da4e57ecd416b803523d7cf41f4c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Urban Sport 1.5 TSI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Urban Sport 1.5 TSI 110kW (150CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981450%27 HTTP/1.1" 200 None
2026-03-24 18:33:50 [ayvens.es] INFO: Saving data for 1981450: {'created_time': 1774377230.142391, 'last_price_update_time': 1774377230.142401, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981450') HTTP/1.1" 204 0
2026-03-24 18:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/053/e9b60874955c4693ad0d49404c466ce5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/463/a0539f84839c4019864ce34c5ae7c6cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:50 [ayvens.es] INFO: Found listing with ID: 1981460
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981460%27 HTTP/1.1" 200 None
2026-03-24 18:33:50 [ayvens.es] INFO: Scrape type for 1981460: 1
2026-03-24 18:33:50 [ayvens.es] INFO: Extracting data for car ID: 1981460
2026-03-24 18:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f553cbf3-02d1-55e5-a69d-e682cb7e7905 with identifier: 1981460
2026-03-24 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f553cbf3-02d1-55e5-a69d-e682cb7e7905 with scrape type 1
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f553cbf3-02d1-55e5-a69d-e682cb7e7905
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F217%252Fd23a1b7eff8c45ddb5b9185b9e944ab3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/217/d23a1b7eff8c45ddb5b9185b9e944ab3/images/large/1.jpg not downloaded yet
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a9250>
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_715e1248-93c5-59c8-bdc8-879aab60af18/715e1248-93c5-59c8-bdc8-879aab60af18_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252Fb4b1ded6a37a4ea2b80fdf857df6a294%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/b4b1ded6a37a4ea2b80fdf857df6a294/images/large/1.jpg saved to cache
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 715e1248-93c5-59c8-bdc8-879aab60af18
2026-03-24 18:33:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 715e1248-93c5-59c8-bdc8-879aab60af18, skipping ID generation
2026-03-24 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 715e1248-93c5-59c8-bdc8-879aab60af18 with scrape type 1
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 715e1248-93c5-59c8-bdc8-879aab60af18 sending to next pipeline
2026-03-24 18:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 715e1248-93c5-59c8-bdc8-879aab60af18, identifier: 1981452
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb87b10>
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3f5d23-6d52-58a7-bab3-e889afaa45fd/9c3f5d23-6d52-58a7-bab3-e889afaa45fd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F9fc9bf043eaf4fe189c5fb9fdfea06f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/9fc9bf043eaf4fe189c5fb9fdfea06f8/images/large/1.jpg saved to cache
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd
2026-03-24 18:33:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd, skipping ID generation
2026-03-24 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with scrape type 1
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd sending to next pipeline
2026-03-24 18:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd, identifier: 1981451
2026-03-24 18:33:50 [ayvens.es] INFO: Found listing with ID: 1981461
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981461%27 HTTP/1.1" 200 None
2026-03-24 18:33:50 [ayvens.es] INFO: Scrape type for 1981461: 1
2026-03-24 18:33:50 [ayvens.es] INFO: Extracting data for car ID: 1981461
2026-03-24 18:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1981461
2026-03-24 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with scrape type 1
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fcb43e8f9cbe64dd69209545cf58af637%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/cb43e8f9cbe64dd69209545cf58af637/images/large/1.jpg not downloaded yet
2026-03-24 18:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 715e1248-93c5-59c8-bdc8-879aab60af18 with identifier: 1981452
2026-03-24 18:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 715e1248-93c5-59c8-bdc8-879aab60af18 with identifier: 1981452
2026-03-24 18:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 715e1248-93c5-59c8-bdc8-879aab60af18 with identifier: 1981452 to the API
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/b4b1ded6a37a4ea2b80fdf857df6a294/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '715e1248-93c5-59c8-bdc8-879aab60af18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 255221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_715e1248-93c5-59c8-bdc8-879aab60af18/715e1248-93c5-59c8-bdc8-879aab60af18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/b4b1ded6a37a4ea2b80fdf857df6a294/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981452%27 HTTP/1.1" 200 None
2026-03-24 18:33:50 [ayvens.es] INFO: Saving data for 1981452: {'created_time': 1774377230.844474, 'last_price_update_time': 1774377230.844488, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981452') HTTP/1.1" 204 0
2026-03-24 18:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1981451
2026-03-24 18:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1981451
2026-03-24 18:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1981451 to the API
2026-03-24 18:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/753/9fc9bf043eaf4fe189c5fb9fdfea06f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9c3f5d23-6d52-58a7-bab3-e889afaa45fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 223722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3f5d23-6d52-58a7-bab3-e889afaa45fd/9c3f5d23-6d52-58a7-bab3-e889afaa45fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/753/9fc9bf043eaf4fe189c5fb9fdfea06f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Sport 2.0 TDI 110kW (150CV) 4Motion DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 110kW (150CV) 4Motion DSG',
 'vin': None,
 'year': 2018}
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981451%27 HTTP/1.1" 200 None
2026-03-24 18:33:51 [ayvens.es] INFO: Saving data for 1981451: {'created_time': 1774377231.135811, 'last_price_update_time': 1774377231.135821, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981451') HTTP/1.1" 204 0
2026-03-24 18:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/517/1582ba35e9f84724853c69d8bea19535/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:51 [ayvens.es] INFO: Found listing with ID: 1981462
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981462%27 HTTP/1.1" 200 None
2026-03-24 18:33:51 [ayvens.es] INFO: Scrape type for 1981462: 1
2026-03-24 18:33:51 [ayvens.es] INFO: Extracting data for car ID: 1981462
2026-03-24 18:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1981462
2026-03-24 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b with scrape type 1
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252Fa147f34e5bce40aaad197183118aaaf1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/a147f34e5bce40aaad197183118aaaf1/images/large/1.jpg not downloaded yet
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee21fd0>
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7c5ef4-4054-5fd3-a521-a6eff055f8a4/ef7c5ef4-4054-5fd3-a521-a6eff055f8a4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F053%252Fe9b60874955c4693ad0d49404c466ce5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/053/e9b60874955c4693ad0d49404c466ce5/images/large/1.jpg saved to cache
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4
2026-03-24 18:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4, skipping ID generation
2026-03-24 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with scrape type 1
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 sending to next pipeline
2026-03-24 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4, identifier: 1981454
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee923a90>
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cbdc45-0be0-5ffd-aea4-b20236a6b621/a7cbdc45-0be0-5ffd-aea4-b20236a6b621_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252Fa0539f84839c4019864ce34c5ae7c6cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/a0539f84839c4019864ce34c5ae7c6cb/images/large/1.jpg saved to cache
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7cbdc45-0be0-5ffd-aea4-b20236a6b621
2026-03-24 18:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7cbdc45-0be0-5ffd-aea4-b20236a6b621, skipping ID generation
2026-03-24 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cbdc45-0be0-5ffd-aea4-b20236a6b621 with scrape type 1
2026-03-24 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7cbdc45-0be0-5ffd-aea4-b20236a6b621 sending to next pipeline
2026-03-24 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a7cbdc45-0be0-5ffd-aea4-b20236a6b621, identifier: 1981453
2026-03-24 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1981454
2026-03-24 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1981454
2026-03-24 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1981454 to the API
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/053/e9b60874955c4693ad0d49404c466ce5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef7c5ef4-4054-5fd3-a521-a6eff055f8a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'YETI',
 'odometer': 215453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7c5ef4-4054-5fd3-a521-a6eff055f8a4/ef7c5ef4-4054-5fd3-a521-a6eff055f8a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/053/e9b60874955c4693ad0d49404c466ce5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA YETI 2.0 TDI 110cv 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110cv 4x4 Ambition',
 'vin': None,
 'year': 2013}
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981454%27 HTTP/1.1" 200 None
2026-03-24 18:33:51 [ayvens.es] INFO: Saving data for 1981454: {'created_time': 1774377231.763203, 'last_price_update_time': 1774377231.763213, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981454') HTTP/1.1" 204 0
2026-03-24 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a7cbdc45-0be0-5ffd-aea4-b20236a6b621 with identifier: 1981453
2026-03-24 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a7cbdc45-0be0-5ffd-aea4-b20236a6b621 with identifier: 1981453
2026-03-24 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a7cbdc45-0be0-5ffd-aea4-b20236a6b621 with identifier: 1981453 to the API
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/463/a0539f84839c4019864ce34c5ae7c6cb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Plata reflex',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a7cbdc45-0be0-5ffd-aea4-b20236a6b621',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 215825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cbdc45-0be0-5ffd-aea4-b20236a6b621/a7cbdc45-0be0-5ffd-aea4-b20236a6b621_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/463/a0539f84839c4019864ce34c5ae7c6cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981453%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [ayvens.es] INFO: Saving data for 1981453: {'created_time': 1774377232.041423, 'last_price_update_time': 1774377232.041433, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981453') HTTP/1.1" 204 0
2026-03-24 18:33:52 [ayvens.es] INFO: Found listing with ID: 1981463
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981463%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [ayvens.es] INFO: Scrape type for 1981463: 1
2026-03-24 18:33:52 [ayvens.es] INFO: Extracting data for car ID: 1981463
2026-03-24 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1981463
2026-03-24 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with scrape type 1
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fcbb5d0a1462a4ecf8f731ee00d205b70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/cbb5d0a1462a4ecf8f731ee00d205b70/images/large/1.jpg not downloaded yet
2026-03-24 18:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/219/f9d4b12adc57413dbc2e7b4912e129bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a1d10>
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf64a30e-0d69-5994-9e23-41880ede47c5/bf64a30e-0d69-5994-9e23-41880ede47c5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F517%252F1582ba35e9f84724853c69d8bea19535%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/517/1582ba35e9f84724853c69d8bea19535/images/large/1.jpg saved to cache
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf64a30e-0d69-5994-9e23-41880ede47c5
2026-03-24 18:33:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf64a30e-0d69-5994-9e23-41880ede47c5, skipping ID generation
2026-03-24 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf64a30e-0d69-5994-9e23-41880ede47c5 with scrape type 1
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf64a30e-0d69-5994-9e23-41880ede47c5 sending to next pipeline
2026-03-24 18:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf64a30e-0d69-5994-9e23-41880ede47c5, identifier: 1981456
2026-03-24 18:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/112/f03af82dac05448392fc3110a33aa62e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/110/18a552532ec0443998fbd1ff6c72bb1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:52 [ayvens.es] INFO: Found listing with ID: 1981464
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981464%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [ayvens.es] INFO: Scrape type for 1981464: 1
2026-03-24 18:33:52 [ayvens.es] INFO: Extracting data for car ID: 1981464
2026-03-24 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de2da893-f8d2-5678-abd4-a67f33b97187 with identifier: 1981464
2026-03-24 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de2da893-f8d2-5678-abd4-a67f33b97187 with scrape type 1
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de2da893-f8d2-5678-abd4-a67f33b97187
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252Fedee268ae4ee488b896833fa9a4fd249%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/edee268ae4ee488b896833fa9a4fd249/images/large/1.jpg not downloaded yet
2026-03-24 18:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1981456
2026-03-24 18:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1981456
2026-03-24 18:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1981456 to the API
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/517/1582ba35e9f84724853c69d8bea19535/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf64a30e-0d69-5994-9e23-41880ede47c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 137851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf64a30e-0d69-5994-9e23-41880ede47c5/bf64a30e-0d69-5994-9e23-41880ede47c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/517/1582ba35e9f84724853c69d8bea19535/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981456%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [ayvens.es] INFO: Saving data for 1981456: {'created_time': 1774377232.660848, 'last_price_update_time': 1774377232.660858, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981456') HTTP/1.1" 204 0
2026-03-24 18:33:52 [ayvens.es] INFO: Found listing with ID: 1981465
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981465%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [ayvens.es] INFO: Scrape type for 1981465: 1
2026-03-24 18:33:52 [ayvens.es] INFO: Extracting data for car ID: 1981465
2026-03-24 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac339170-2915-5a2d-9916-95a24ceeb884 with identifier: 1981465
2026-03-24 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac339170-2915-5a2d-9916-95a24ceeb884 with scrape type 1
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ac339170-2915-5a2d-9916-95a24ceeb884
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Fea9247197cdb42da99fdfa8d6a7617e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/ea9247197cdb42da99fdfa8d6a7617e1/images/large/1.jpg not downloaded yet
2026-03-24 18:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/217/d23a1b7eff8c45ddb5b9185b9e944ab3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/970/b8657111531546159eaeb4851d87c18e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a1f10>
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a562b0b-502a-5a4c-a1f2-a3ace3f7598e/0a562b0b-502a-5a4c-a1f2-a3ace3f7598e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F219%252Ff9d4b12adc57413dbc2e7b4912e129bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/219/f9d4b12adc57413dbc2e7b4912e129bb/images/large/1.jpg saved to cache
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e
2026-03-24 18:33:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e, skipping ID generation
2026-03-24 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e with scrape type 1
2026-03-24 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e sending to next pipeline
2026-03-24 18:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e, identifier: 1981455
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb13b10>
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8843392-10fb-5ef7-92fa-010a4ce10933/b8843392-10fb-5ef7-92fa-010a4ce10933_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252Ff03af82dac05448392fc3110a33aa62e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/f03af82dac05448392fc3110a33aa62e/images/large/1.jpg saved to cache
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8843392-10fb-5ef7-92fa-010a4ce10933
2026-03-24 18:33:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8843392-10fb-5ef7-92fa-010a4ce10933, skipping ID generation
2026-03-24 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8843392-10fb-5ef7-92fa-010a4ce10933 with scrape type 1
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8843392-10fb-5ef7-92fa-010a4ce10933 sending to next pipeline
2026-03-24 18:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b8843392-10fb-5ef7-92fa-010a4ce10933, identifier: 1981457
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea72dd0>
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3b6f29-42d5-5ad6-95f6-322a61a8b030/6c3b6f29-42d5-5ad6-95f6-322a61a8b030_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252F18a552532ec0443998fbd1ff6c72bb1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/18a552532ec0443998fbd1ff6c72bb1a/images/large/1.jpg saved to cache
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c3b6f29-42d5-5ad6-95f6-322a61a8b030
2026-03-24 18:33:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c3b6f29-42d5-5ad6-95f6-322a61a8b030, skipping ID generation
2026-03-24 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3b6f29-42d5-5ad6-95f6-322a61a8b030 with scrape type 1
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c3b6f29-42d5-5ad6-95f6-322a61a8b030 sending to next pipeline
2026-03-24 18:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6c3b6f29-42d5-5ad6-95f6-322a61a8b030, identifier: 1981458
2026-03-24 18:33:53 [ayvens.es] INFO: Found listing with ID: 1981466
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981466%27 HTTP/1.1" 200 None
2026-03-24 18:33:53 [ayvens.es] INFO: Scrape type for 1981466: 1
2026-03-24 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1981466
2026-03-24 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1981466
2026-03-24 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a301af07-8f69-50e1-a653-bd80f20e63cf with scrape type 1
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a301af07-8f69-50e1-a653-bd80f20e63cf
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F74772e59df884a99ac69a7fa85b602ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/74772e59df884a99ac69a7fa85b602ed/images/large/1.jpg not downloaded yet
2026-03-24 18:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e with identifier: 1981455
2026-03-24 18:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e with identifier: 1981455
2026-03-24 18:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0a562b0b-502a-5a4c-a1f2-a3ace3f7598e with identifier: 1981455 to the API
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/219/f9d4b12adc57413dbc2e7b4912e129bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a562b0b-502a-5a4c-a1f2-a3ace3f7598e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 85750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a562b0b-502a-5a4c-a1f2-a3ace3f7598e/0a562b0b-502a-5a4c-a1f2-a3ace3f7598e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/219/f9d4b12adc57413dbc2e7b4912e129bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981455%27 HTTP/1.1" 200 None
2026-03-24 18:33:53 [ayvens.es] INFO: Saving data for 1981455: {'created_time': 1774377233.704997, 'last_price_update_time': 1774377233.70501, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981455') HTTP/1.1" 204 0
2026-03-24 18:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1981457
2026-03-24 18:33:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1981457
2026-03-24 18:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1981457 to the API
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/112/f03af82dac05448392fc3110a33aa62e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b8843392-10fb-5ef7-92fa-010a4ce10933',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 72366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8843392-10fb-5ef7-92fa-010a4ce10933/b8843392-10fb-5ef7-92fa-010a4ce10933_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/112/f03af82dac05448392fc3110a33aa62e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981457%27 HTTP/1.1" 200 None
2026-03-24 18:33:54 [ayvens.es] INFO: Saving data for 1981457: {'created_time': 1774377234.007972, 'last_price_update_time': 1774377234.007987, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981457') HTTP/1.1" 204 0
2026-03-24 18:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6c3b6f29-42d5-5ad6-95f6-322a61a8b030 with identifier: 1981458
2026-03-24 18:33:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6c3b6f29-42d5-5ad6-95f6-322a61a8b030 with identifier: 1981458
2026-03-24 18:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6c3b6f29-42d5-5ad6-95f6-322a61a8b030 with identifier: 1981458 to the API
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/110/18a552532ec0443998fbd1ff6c72bb1a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Azul aguamarina',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6c3b6f29-42d5-5ad6-95f6-322a61a8b030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 104853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3b6f29-42d5-5ad6-95f6-322a61a8b030/6c3b6f29-42d5-5ad6-95f6-322a61a8b030_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/110/18a552532ec0443998fbd1ff6c72bb1a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981458%27 HTTP/1.1" 200 None
2026-03-24 18:33:54 [ayvens.es] INFO: Saving data for 1981458: {'created_time': 1774377234.337899, 'last_price_update_time': 1774377234.337914, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981458') HTTP/1.1" 204 0
2026-03-24 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/002/a147f34e5bce40aaad197183118aaaf1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:54 [ayvens.es] INFO: Found listing with ID: 1981467
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981467%27 HTTP/1.1" 200 None
2026-03-24 18:33:54 [ayvens.es] INFO: Scrape type for 1981467: 1
2026-03-24 18:33:54 [ayvens.es] INFO: Extracting data for car ID: 1981467
2026-03-24 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d88ca9-68d6-5119-a5cb-793ad26e52b6 with identifier: 1981467
2026-03-24 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d88ca9-68d6-5119-a5cb-793ad26e52b6 with scrape type 1
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 87d88ca9-68d6-5119-a5cb-793ad26e52b6
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252Fd0d56a310c584ddaa0f34f30832a8021%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/d0d56a310c584ddaa0f34f30832a8021/images/large/1.jpg not downloaded yet
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8d3990>
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f553cbf3-02d1-55e5-a69d-e682cb7e7905/f553cbf3-02d1-55e5-a69d-e682cb7e7905_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F217%252Fd23a1b7eff8c45ddb5b9185b9e944ab3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/217/d23a1b7eff8c45ddb5b9185b9e944ab3/images/large/1.jpg saved to cache
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f553cbf3-02d1-55e5-a69d-e682cb7e7905
2026-03-24 18:33:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f553cbf3-02d1-55e5-a69d-e682cb7e7905, skipping ID generation
2026-03-24 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f553cbf3-02d1-55e5-a69d-e682cb7e7905 with scrape type 1
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f553cbf3-02d1-55e5-a69d-e682cb7e7905 sending to next pipeline
2026-03-24 18:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f553cbf3-02d1-55e5-a69d-e682cb7e7905, identifier: 1981460
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e5390>
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d666b5f-9995-5d0d-87af-67bf916b04dd/3d666b5f-9995-5d0d-87af-67bf916b04dd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F970%252Fb8657111531546159eaeb4851d87c18e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/970/b8657111531546159eaeb4851d87c18e/images/large/1.jpg saved to cache
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d666b5f-9995-5d0d-87af-67bf916b04dd
2026-03-24 18:33:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d666b5f-9995-5d0d-87af-67bf916b04dd, skipping ID generation
2026-03-24 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d666b5f-9995-5d0d-87af-67bf916b04dd with scrape type 1
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d666b5f-9995-5d0d-87af-67bf916b04dd sending to next pipeline
2026-03-24 18:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d666b5f-9995-5d0d-87af-67bf916b04dd, identifier: 1981459
2026-03-24 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/021/cb43e8f9cbe64dd69209545cf58af637/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:54 [ayvens.es] INFO: Found listing with ID: 1981468
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981468%27 HTTP/1.1" 200 None
2026-03-24 18:33:54 [ayvens.es] INFO: Scrape type for 1981468: 1
2026-03-24 18:33:54 [ayvens.es] INFO: Extracting data for car ID: 1981468
2026-03-24 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3733bb88-3cc5-564a-a2ad-a65986d657ad with identifier: 1981468
2026-03-24 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3733bb88-3cc5-564a-a2ad-a65986d657ad with scrape type 1
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3733bb88-3cc5-564a-a2ad-a65986d657ad
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252Fadaf5a375e3b4c83a408b23cab84b6b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/adaf5a375e3b4c83a408b23cab84b6b5/images/large/1.jpg not downloaded yet
2026-03-24 18:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f553cbf3-02d1-55e5-a69d-e682cb7e7905 with identifier: 1981460
2026-03-24 18:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f553cbf3-02d1-55e5-a69d-e682cb7e7905 with identifier: 1981460
2026-03-24 18:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f553cbf3-02d1-55e5-a69d-e682cb7e7905 with identifier: 1981460 to the API
2026-03-24 18:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/217/d23a1b7eff8c45ddb5b9185b9e944ab3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f553cbf3-02d1-55e5-a69d-e682cb7e7905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 80644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f553cbf3-02d1-55e5-a69d-e682cb7e7905/f553cbf3-02d1-55e5-a69d-e682cb7e7905_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/217/d23a1b7eff8c45ddb5b9185b9e944ab3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 (O) 2.0 D4 Business Plus Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D4 Business Plus Auto',
 'vin': None,
 'year': 2020}
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981460%27 HTTP/1.1" 200 None
2026-03-24 18:33:55 [ayvens.es] INFO: Saving data for 1981460: {'created_time': 1774377235.14252, 'last_price_update_time': 1774377235.14253, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981460') HTTP/1.1" 204 0
2026-03-24 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d666b5f-9995-5d0d-87af-67bf916b04dd with identifier: 1981459
2026-03-24 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d666b5f-9995-5d0d-87af-67bf916b04dd with identifier: 1981459
2026-03-24 18:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d666b5f-9995-5d0d-87af-67bf916b04dd with identifier: 1981459 to the API
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/970/b8657111531546159eaeb4851d87c18e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'Gris delf',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d666b5f-9995-5d0d-87af-67bf916b04dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 187886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d666b5f-9995-5d0d-87af-67bf916b04dd/3d666b5f-9995-5d0d-87af-67bf916b04dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/970/b8657111531546159eaeb4851d87c18e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981459%27 HTTP/1.1" 200 None
2026-03-24 18:33:55 [ayvens.es] INFO: Saving data for 1981459: {'created_time': 1774377235.427466, 'last_price_update_time': 1774377235.427477, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981459') HTTP/1.1" 204 0
2026-03-24 18:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/240/cbb5d0a1462a4ecf8f731ee00d205b70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:55 [ayvens.es] INFO: Found listing with ID: 1981469
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981469%27 HTTP/1.1" 200 None
2026-03-24 18:33:55 [ayvens.es] INFO: Scrape type for 1981469: 1
2026-03-24 18:33:55 [ayvens.es] INFO: Extracting data for car ID: 1981469
2026-03-24 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22f28e34-6399-5028-9d1f-f9753a176ea4 with identifier: 1981469
2026-03-24 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22f28e34-6399-5028-9d1f-f9753a176ea4 with scrape type 1
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 22f28e34-6399-5028-9d1f-f9753a176ea4
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F904%252F438503f7d08d4d17ae3bdead98bfe924%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/904/438503f7d08d4d17ae3bdead98bfe924/images/large/1.jpg not downloaded yet
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea94950>
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d218ab-4e2f-5e23-94fd-14159e6ca65b/36d218ab-4e2f-5e23-94fd-14159e6ca65b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252Fa147f34e5bce40aaad197183118aaaf1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/a147f34e5bce40aaad197183118aaaf1/images/large/1.jpg saved to cache
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b
2026-03-24 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36d218ab-4e2f-5e23-94fd-14159e6ca65b, skipping ID generation
2026-03-24 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b with scrape type 1
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b sending to next pipeline
2026-03-24 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36d218ab-4e2f-5e23-94fd-14159e6ca65b, identifier: 1981462
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1c8e10>
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f0bf6aa-67ae-5474-b95b-cae7299e8d1f/0f0bf6aa-67ae-5474-b95b-cae7299e8d1f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fcb43e8f9cbe64dd69209545cf58af637%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/cb43e8f9cbe64dd69209545cf58af637/images/large/1.jpg saved to cache
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f
2026-03-24 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f, skipping ID generation
2026-03-24 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with scrape type 1
2026-03-24 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f sending to next pipeline
2026-03-24 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f, identifier: 1981461
2026-03-24 18:33:55 [ayvens.es] INFO: Found listing with ID: 1981470
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981470%27 HTTP/1.1" 200 None
2026-03-24 18:33:56 [ayvens.es] INFO: Scrape type for 1981470: 1
2026-03-24 18:33:56 [ayvens.es] INFO: Extracting data for car ID: 1981470
2026-03-24 18:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1981470
2026-03-24 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d with scrape type 1
2026-03-24 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F95079e0e81234d459e72125915ba4a5d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/95079e0e81234d459e72125915ba4a5d/images/large/1.jpg not downloaded yet
2026-03-24 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1981462
2026-03-24 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1981462
2026-03-24 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1981462 to the API
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/002/a147f34e5bce40aaad197183118aaaf1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '36d218ab-4e2f-5e23-94fd-14159e6ca65b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 103809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d218ab-4e2f-5e23-94fd-14159e6ca65b/36d218ab-4e2f-5e23-94fd-14159e6ca65b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/002/a147f34e5bce40aaad197183118aaaf1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981462%27 HTTP/1.1" 200 None
2026-03-24 18:33:56 [ayvens.es] INFO: Saving data for 1981462: {'created_time': 1774377236.36359, 'last_price_update_time': 1774377236.363601, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981462') HTTP/1.1" 204 0
2026-03-24 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1981461
2026-03-24 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1981461
2026-03-24 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1981461 to the API
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/021/cb43e8f9cbe64dd69209545cf58af637/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0f0bf6aa-67ae-5474-b95b-cae7299e8d1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 203865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf6aa-67ae-5474-b95b-cae7299e8d1f/0f0bf6aa-67ae-5474-b95b-cae7299e8d1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/021/cb43e8f9cbe64dd69209545cf58af637/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS E-CVT TOURING SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS E-CVT TOURING SPORT',
 'vin': None,
 'year': 2019}
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981461%27 HTTP/1.1" 200 None
2026-03-24 18:33:56 [ayvens.es] INFO: Saving data for 1981461: {'created_time': 1774377236.68835, 'last_price_update_time': 1774377236.688364, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981461') HTTP/1.1" 204 0
2026-03-24 18:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/643/edee268ae4ee488b896833fa9a4fd249/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee80090>
2026-03-24 18:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8/3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fcbb5d0a1462a4ecf8f731ee00d205b70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/cbb5d0a1462a4ecf8f731ee00d205b70/images/large/1.jpg saved to cache
2026-03-24 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8
2026-03-24 18:33:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8, skipping ID generation
2026-03-24 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with scrape type 1
2026-03-24 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 sending to next pipeline
2026-03-24 18:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8, identifier: 1981463
2026-03-24 18:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/469/ea9247197cdb42da99fdfa8d6a7617e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:56 [ayvens.es] INFO: Found listing with ID: 1981471
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981471%27 HTTP/1.1" 200 None
2026-03-24 18:33:56 [ayvens.es] INFO: Scrape type for 1981471: 1
2026-03-24 18:33:56 [ayvens.es] INFO: Extracting data for car ID: 1981471
2026-03-24 18:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d228c694-80b7-5e01-8548-3b483883e712 with identifier: 1981471
2026-03-24 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d228c694-80b7-5e01-8548-3b483883e712 with scrape type 1
2026-03-24 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d228c694-80b7-5e01-8548-3b483883e712
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252F89c5a451463c4d249d33b8344f0a7081%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/89c5a451463c4d249d33b8344f0a7081/images/large/1.jpg not downloaded yet
2026-03-24 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1981463
2026-03-24 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1981463
2026-03-24 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1981463 to the API
2026-03-24 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/240/cbb5d0a1462a4ecf8f731ee00d205b70/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 133203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8/3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/240/cbb5d0a1462a4ecf8f731ee00d205b70/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Business 4WD',
 'transmission': 'manual',
 'trim': '2.5l 220H Business 4WD',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981463%27 HTTP/1.1" 200 None
2026-03-24 18:33:57 [ayvens.es] INFO: Saving data for 1981463: {'created_time': 1774377237.173642, 'last_price_update_time': 1774377237.173656, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981463') HTTP/1.1" 204 0
2026-03-24 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/820/74772e59df884a99ac69a7fa85b602ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:57 [ayvens.es] INFO: Found listing with ID: 1981472
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981472%27 HTTP/1.1" 200 None
2026-03-24 18:33:57 [ayvens.es] INFO: Scrape type for 1981472: 1
2026-03-24 18:33:57 [ayvens.es] INFO: Extracting data for car ID: 1981472
2026-03-24 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 484af6ea-a864-54de-a358-cc6c00f97b8f with identifier: 1981472
2026-03-24 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484af6ea-a864-54de-a358-cc6c00f97b8f with scrape type 1
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 484af6ea-a864-54de-a358-cc6c00f97b8f
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F398%252F31f913343a464d4b84597f68f853547f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/398/31f913343a464d4b84597f68f853547f/images/large/1.jpg not downloaded yet
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb869d0>
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2da893-f8d2-5678-abd4-a67f33b97187/de2da893-f8d2-5678-abd4-a67f33b97187_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252Fedee268ae4ee488b896833fa9a4fd249%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/edee268ae4ee488b896833fa9a4fd249/images/large/1.jpg saved to cache
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de2da893-f8d2-5678-abd4-a67f33b97187
2026-03-24 18:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de2da893-f8d2-5678-abd4-a67f33b97187, skipping ID generation
2026-03-24 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de2da893-f8d2-5678-abd4-a67f33b97187 with scrape type 1
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de2da893-f8d2-5678-abd4-a67f33b97187 sending to next pipeline
2026-03-24 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de2da893-f8d2-5678-abd4-a67f33b97187, identifier: 1981464
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee22df50>
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac339170-2915-5a2d-9916-95a24ceeb884/ac339170-2915-5a2d-9916-95a24ceeb884_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Fea9247197cdb42da99fdfa8d6a7617e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/ea9247197cdb42da99fdfa8d6a7617e1/images/large/1.jpg saved to cache
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac339170-2915-5a2d-9916-95a24ceeb884
2026-03-24 18:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac339170-2915-5a2d-9916-95a24ceeb884, skipping ID generation
2026-03-24 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac339170-2915-5a2d-9916-95a24ceeb884 with scrape type 1
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac339170-2915-5a2d-9916-95a24ceeb884 sending to next pipeline
2026-03-24 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ac339170-2915-5a2d-9916-95a24ceeb884, identifier: 1981465
2026-03-24 18:33:57 [ayvens.es] INFO: Found listing with ID: 1981473
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981473%27 HTTP/1.1" 200 None
2026-03-24 18:33:57 [ayvens.es] INFO: Scrape type for 1981473: 1
2026-03-24 18:33:57 [ayvens.es] INFO: Extracting data for car ID: 1981473
2026-03-24 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1671e095-76a0-5ee1-8c79-6c13af3f2821 with identifier: 1981473
2026-03-24 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1671e095-76a0-5ee1-8c79-6c13af3f2821 with scrape type 1
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1671e095-76a0-5ee1-8c79-6c13af3f2821
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252Faddf021ae94941ef98d5273effa783a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/addf021ae94941ef98d5273effa783a6/images/large/1.jpg not downloaded yet
2026-03-24 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de2da893-f8d2-5678-abd4-a67f33b97187 with identifier: 1981464
2026-03-24 18:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de2da893-f8d2-5678-abd4-a67f33b97187 with identifier: 1981464
2026-03-24 18:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de2da893-f8d2-5678-abd4-a67f33b97187 with identifier: 1981464 to the API
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/643/edee268ae4ee488b896833fa9a4fd249/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'de2da893-f8d2-5678-abd4-a67f33b97187',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 40063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2da893-f8d2-5678-abd4-a67f33b97187/de2da893-f8d2-5678-abd4-a67f33b97187_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/643/edee268ae4ee488b896833fa9a4fd249/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Intens TCe 67 kW (91CV)',
 'transmission': 'manual',
 'trim': 'Intens TCe 67 kW (91CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981464%27 HTTP/1.1" 200 None
2026-03-24 18:33:57 [ayvens.es] INFO: Saving data for 1981464: {'created_time': 1774377237.858384, 'last_price_update_time': 1774377237.858394, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981464') HTTP/1.1" 204 0
2026-03-24 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ac339170-2915-5a2d-9916-95a24ceeb884 with identifier: 1981465
2026-03-24 18:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ac339170-2915-5a2d-9916-95a24ceeb884 with identifier: 1981465
2026-03-24 18:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ac339170-2915-5a2d-9916-95a24ceeb884 with identifier: 1981465 to the API
2026-03-24 18:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/469/ea9247197cdb42da99fdfa8d6a7617e1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ac339170-2915-5a2d-9916-95a24ceeb884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 134443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac339170-2915-5a2d-9916-95a24ceeb884/ac339170-2915-5a2d-9916-95a24ceeb884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/469/ea9247197cdb42da99fdfa8d6a7617e1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981465%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [ayvens.es] INFO: Saving data for 1981465: {'created_time': 1774377238.172939, 'last_price_update_time': 1774377238.17295, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981465') HTTP/1.1" 204 0
2026-03-24 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/449/d0d56a310c584ddaa0f34f30832a8021/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:58 [ayvens.es] INFO: Found listing with ID: 1981474
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981474%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [ayvens.es] INFO: Scrape type for 1981474: 1
2026-03-24 18:33:58 [ayvens.es] INFO: Extracting data for car ID: 1981474
2026-03-24 18:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1981474
2026-03-24 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc0de46-af2b-5680-a07c-6d502dce14f5 with scrape type 1
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1fc0de46-af2b-5680-a07c-6d502dce14f5
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252Fb6b7e6c242d94d7685c4dd29966ee08a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/b6b7e6c242d94d7685c4dd29966ee08a/images/large/1.jpg not downloaded yet
2026-03-24 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/616/adaf5a375e3b4c83a408b23cab84b6b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee232750>
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a301af07-8f69-50e1-a653-bd80f20e63cf/a301af07-8f69-50e1-a653-bd80f20e63cf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F74772e59df884a99ac69a7fa85b602ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/74772e59df884a99ac69a7fa85b602ed/images/large/1.jpg saved to cache
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a301af07-8f69-50e1-a653-bd80f20e63cf
2026-03-24 18:33:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a301af07-8f69-50e1-a653-bd80f20e63cf, skipping ID generation
2026-03-24 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a301af07-8f69-50e1-a653-bd80f20e63cf with scrape type 1
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a301af07-8f69-50e1-a653-bd80f20e63cf sending to next pipeline
2026-03-24 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a301af07-8f69-50e1-a653-bd80f20e63cf, identifier: 1981466
2026-03-24 18:33:58 [ayvens.es] INFO: Found listing with ID: 1981475
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981475%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [ayvens.es] INFO: Scrape type for 1981475: 1
2026-03-24 18:33:58 [ayvens.es] INFO: Extracting data for car ID: 1981475
2026-03-24 18:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c95ec5-03ba-5275-bdf0-389bd45e641f with identifier: 1981475
2026-03-24 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c95ec5-03ba-5275-bdf0-389bd45e641f with scrape type 1
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 98c95ec5-03ba-5275-bdf0-389bd45e641f
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252F02153c8a94f24653b6017a91755d6c0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/02153c8a94f24653b6017a91755d6c0f/images/large/1.jpg not downloaded yet
2026-03-24 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1981466
2026-03-24 18:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1981466
2026-03-24 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1981466 to the API
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/820/74772e59df884a99ac69a7fa85b602ed/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a301af07-8f69-50e1-a653-bd80f20e63cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 158834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a301af07-8f69-50e1-a653-bd80f20e63cf/a301af07-8f69-50e1-a653-bd80f20e63cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/820/74772e59df884a99ac69a7fa85b602ed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981466%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [ayvens.es] INFO: Saving data for 1981466: {'created_time': 1774377238.699654, 'last_price_update_time': 1774377238.699663, 'auction_closing_time': 1774440000.0}
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981466') HTTP/1.1" 204 0
2026-03-24 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/904/438503f7d08d4d17ae3bdead98bfe924/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/95079e0e81234d459e72125915ba4a5d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:58 [ayvens.es] INFO: Found listing with ID: 1981476
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981476%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [ayvens.es] INFO: Scrape type for 1981476: 1
2026-03-24 18:33:58 [ayvens.es] INFO: Extracting data for car ID: 1981476
2026-03-24 18:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1981476
2026-03-24 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff2e819-62e6-57ad-a159-bc7536562961 with scrape type 1
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fff2e819-62e6-57ad-a159-bc7536562961
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F348%252Ff804bf2085dd4f41853860a501fcc71b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/348/f804bf2085dd4f41853860a501fcc71b/images/large/1.jpg not downloaded yet
2026-03-24 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/535/89c5a451463c4d249d33b8344f0a7081/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0c17d0>
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d88ca9-68d6-5119-a5cb-793ad26e52b6/87d88ca9-68d6-5119-a5cb-793ad26e52b6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252Fd0d56a310c584ddaa0f34f30832a8021%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/d0d56a310c584ddaa0f34f30832a8021/images/large/1.jpg saved to cache
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87d88ca9-68d6-5119-a5cb-793ad26e52b6
2026-03-24 18:33:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87d88ca9-68d6-5119-a5cb-793ad26e52b6, skipping ID generation
2026-03-24 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d88ca9-68d6-5119-a5cb-793ad26e52b6 with scrape type 1
2026-03-24 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87d88ca9-68d6-5119-a5cb-793ad26e52b6 sending to next pipeline
2026-03-24 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 87d88ca9-68d6-5119-a5cb-793ad26e52b6, identifier: 1981467
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0c0c10>
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3733bb88-3cc5-564a-a2ad-a65986d657ad/3733bb88-3cc5-564a-a2ad-a65986d657ad_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252Fadaf5a375e3b4c83a408b23cab84b6b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/adaf5a375e3b4c83a408b23cab84b6b5/images/large/1.jpg saved to cache
2026-03-24 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3733bb88-3cc5-564a-a2ad-a65986d657ad
2026-03-24 18:33:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3733bb88-3cc5-564a-a2ad-a65986d657ad, skipping ID generation
2026-03-24 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3733bb88-3cc5-564a-a2ad-a65986d657ad with scrape type 1
2026-03-24 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3733bb88-3cc5-564a-a2ad-a65986d657ad sending to next pipeline
2026-03-24 18:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3733bb88-3cc5-564a-a2ad-a65986d657ad, identifier: 1981468
2026-03-24 18:33:59 [ayvens.es] INFO: Found listing with ID: 1981477
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981477%27 HTTP/1.1" 200 None
2026-03-24 18:33:59 [ayvens.es] INFO: Scrape type for 1981477: 1
2026-03-24 18:33:59 [ayvens.es] INFO: Extracting data for car ID: 1981477
2026-03-24 18:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1981477
2026-03-24 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc63f20-9c5c-5c87-8c2a-c10631564033 with scrape type 1
2026-03-24 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item abc63f20-9c5c-5c87-8c2a-c10631564033
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252Fbdfbdf72583a4b67a793d2ee4cb4a0a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/bdfbdf72583a4b67a793d2ee4cb4a0a8/images/large/1.jpg not downloaded yet
2026-03-24 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 87d88ca9-68d6-5119-a5cb-793ad26e52b6 with identifier: 1981467
2026-03-24 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 87d88ca9-68d6-5119-a5cb-793ad26e52b6 with identifier: 1981467
2026-03-24 18:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 87d88ca9-68d6-5119-a5cb-793ad26e52b6 with identifier: 1981467 to the API
2026-03-24 18:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/449/d0d56a310c584ddaa0f34f30832a8021/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Crystal white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '87d88ca9-68d6-5119-a5cb-793ad26e52b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 53589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d88ca9-68d6-5119-a5cb-793ad26e52b6/87d88ca9-68d6-5119-a5cb-793ad26e52b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/449/d0d56a310c584ddaa0f34f30832a8021/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 D3 Momentum Pro Auto',
 'transmission': 'manual',
 'trim': '2.0 D3 Momentum Pro Auto',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981467%27 HTTP/1.1" 200 None
2026-03-24 18:34:00 [ayvens.es] INFO: Saving data for 1981467: {'created_time': 1774377240.228213, 'last_price_update_time': 1774377240.228223, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981467') HTTP/1.1" 204 0
2026-03-24 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3733bb88-3cc5-564a-a2ad-a65986d657ad with identifier: 1981468
2026-03-24 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3733bb88-3cc5-564a-a2ad-a65986d657ad with identifier: 1981468
2026-03-24 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3733bb88-3cc5-564a-a2ad-a65986d657ad with identifier: 1981468 to the API
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/616/adaf5a375e3b4c83a408b23cab84b6b5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3733bb88-3cc5-564a-a2ad-a65986d657ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 147347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3733bb88-3cc5-564a-a2ad-a65986d657ad/3733bb88-3cc5-564a-a2ad-a65986d657ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/616/adaf5a375e3b4c83a408b23cab84b6b5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981468%27 HTTP/1.1" 200 None
2026-03-24 18:34:00 [ayvens.es] INFO: Saving data for 1981468: {'created_time': 1774377240.515692, 'last_price_update_time': 1774377240.515701, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981468') HTTP/1.1" 204 0
2026-03-24 18:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/398/31f913343a464d4b84597f68f853547f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:00 [ayvens.es] INFO: Found listing with ID: 1981478
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981478%27 HTTP/1.1" 200 None
2026-03-24 18:34:00 [ayvens.es] INFO: Scrape type for 1981478: 1
2026-03-24 18:34:00 [ayvens.es] INFO: Extracting data for car ID: 1981478
2026-03-24 18:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35c6e2a9-2703-54c4-94b1-1a23cae4878c with identifier: 1981478
2026-03-24 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c6e2a9-2703-54c4-94b1-1a23cae4878c with scrape type 1
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35c6e2a9-2703-54c4-94b1-1a23cae4878c
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252F43140e3c6bb74009b6afd5a5692bbfb2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/43140e3c6bb74009b6afd5a5692bbfb2/images/large/1.jpg not downloaded yet
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9e3cd0>
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f28e34-6399-5028-9d1f-f9753a176ea4/22f28e34-6399-5028-9d1f-f9753a176ea4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F904%252F438503f7d08d4d17ae3bdead98bfe924%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/904/438503f7d08d4d17ae3bdead98bfe924/images/large/1.jpg saved to cache
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22f28e34-6399-5028-9d1f-f9753a176ea4
2026-03-24 18:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22f28e34-6399-5028-9d1f-f9753a176ea4, skipping ID generation
2026-03-24 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22f28e34-6399-5028-9d1f-f9753a176ea4 with scrape type 1
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22f28e34-6399-5028-9d1f-f9753a176ea4 sending to next pipeline
2026-03-24 18:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 22f28e34-6399-5028-9d1f-f9753a176ea4, identifier: 1981469
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05eefd0>
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b37f7e97-3e8c-575d-bc8b-a7e4838f144d/b37f7e97-3e8c-575d-bc8b-a7e4838f144d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F95079e0e81234d459e72125915ba4a5d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/95079e0e81234d459e72125915ba4a5d/images/large/1.jpg saved to cache
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d
2026-03-24 18:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b37f7e97-3e8c-575d-bc8b-a7e4838f144d, skipping ID generation
2026-03-24 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d with scrape type 1
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d sending to next pipeline
2026-03-24 18:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b37f7e97-3e8c-575d-bc8b-a7e4838f144d, identifier: 1981470
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed49e10>
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d228c694-80b7-5e01-8548-3b483883e712/d228c694-80b7-5e01-8548-3b483883e712_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252F89c5a451463c4d249d33b8344f0a7081%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/89c5a451463c4d249d33b8344f0a7081/images/large/1.jpg saved to cache
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d228c694-80b7-5e01-8548-3b483883e712
2026-03-24 18:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d228c694-80b7-5e01-8548-3b483883e712, skipping ID generation
2026-03-24 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d228c694-80b7-5e01-8548-3b483883e712 with scrape type 1
2026-03-24 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d228c694-80b7-5e01-8548-3b483883e712 sending to next pipeline
2026-03-24 18:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d228c694-80b7-5e01-8548-3b483883e712, identifier: 1981471
2026-03-24 18:34:01 [ayvens.es] INFO: Found listing with ID: 1981479
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981479%27 HTTP/1.1" 200 None
2026-03-24 18:34:01 [ayvens.es] INFO: Scrape type for 1981479: 1
2026-03-24 18:34:01 [ayvens.es] INFO: Extracting data for car ID: 1981479
2026-03-24 18:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1981479
2026-03-24 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee with scrape type 1
2026-03-24 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252F85d5cad74e284039b8a5e57da1811580%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/85d5cad74e284039b8a5e57da1811580/images/large/1.jpg not downloaded yet
2026-03-24 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 22f28e34-6399-5028-9d1f-f9753a176ea4 with identifier: 1981469
2026-03-24 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 22f28e34-6399-5028-9d1f-f9753a176ea4 with identifier: 1981469
2026-03-24 18:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 22f28e34-6399-5028-9d1f-f9753a176ea4 with identifier: 1981469 to the API
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/904/438503f7d08d4d17ae3bdead98bfe924/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Gris manganeso metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '22f28e34-6399-5028-9d1f-f9753a176ea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 57246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f28e34-6399-5028-9d1f-f9753a176ea4/22f28e34-6399-5028-9d1f-f9753a176ea4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/904/438503f7d08d4d17ae3bdead98bfe924/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON (O) R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': '(O) R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981469%27 HTTP/1.1" 200 None
2026-03-24 18:34:01 [ayvens.es] INFO: Saving data for 1981469: {'created_time': 1774377241.392533, 'last_price_update_time': 1774377241.392543, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981469') HTTP/1.1" 204 0
2026-03-24 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1981470
2026-03-24 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1981470
2026-03-24 18:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1981470 to the API
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/95079e0e81234d459e72125915ba4a5d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Amarillo lima metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b37f7e97-3e8c-575d-bc8b-a7e4838f144d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 35487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b37f7e97-3e8c-575d-bc8b-a7e4838f144d/b37f7e97-3e8c-575d-bc8b-a7e4838f144d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/95079e0e81234d459e72125915ba4a5d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981470%27 HTTP/1.1" 200 None
2026-03-24 18:34:01 [ayvens.es] INFO: Saving data for 1981470: {'created_time': 1774377241.693912, 'last_price_update_time': 1774377241.693923, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981470') HTTP/1.1" 204 0
2026-03-24 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d228c694-80b7-5e01-8548-3b483883e712 with identifier: 1981471
2026-03-24 18:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d228c694-80b7-5e01-8548-3b483883e712 with identifier: 1981471
2026-03-24 18:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d228c694-80b7-5e01-8548-3b483883e712 with identifier: 1981471 to the API
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/535/89c5a451463c4d249d33b8344f0a7081/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd228c694-80b7-5e01-8548-3b483883e712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 176158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d228c694-80b7-5e01-8548-3b483883e712/d228c694-80b7-5e01-8548-3b483883e712_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/89c5a451463c4d249d33b8344f0a7081/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Edition 1.6 TDI 59kW (80CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 59kW (80CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981471%27 HTTP/1.1" 200 None
2026-03-24 18:34:01 [ayvens.es] INFO: Saving data for 1981471: {'created_time': 1774377241.983146, 'last_price_update_time': 1774377241.983157, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981471') HTTP/1.1" 204 0
2026-03-24 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/b6b7e6c242d94d7685c4dd29966ee08a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:02 [ayvens.es] INFO: Found listing with ID: 1981480
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981480%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [ayvens.es] INFO: Scrape type for 1981480: 1
2026-03-24 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1981480
2026-03-24 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47c47e4e-e1b3-5d77-88ce-359ac178b353 with identifier: 1981480
2026-03-24 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47c47e4e-e1b3-5d77-88ce-359ac178b353 with scrape type 1
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 47c47e4e-e1b3-5d77-88ce-359ac178b353
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F015%252Fce22952cfd884217af89b8be4fb76738%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/015/ce22952cfd884217af89b8be4fb76738/images/large/1.jpg not downloaded yet
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08ec050>
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484af6ea-a864-54de-a358-cc6c00f97b8f/484af6ea-a864-54de-a358-cc6c00f97b8f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F398%252F31f913343a464d4b84597f68f853547f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/398/31f913343a464d4b84597f68f853547f/images/large/1.jpg saved to cache
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 484af6ea-a864-54de-a358-cc6c00f97b8f
2026-03-24 18:34:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 484af6ea-a864-54de-a358-cc6c00f97b8f, skipping ID generation
2026-03-24 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484af6ea-a864-54de-a358-cc6c00f97b8f with scrape type 1
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 484af6ea-a864-54de-a358-cc6c00f97b8f sending to next pipeline
2026-03-24 18:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 484af6ea-a864-54de-a358-cc6c00f97b8f, identifier: 1981472
2026-03-24 18:34:02 [ayvens.es] INFO: Found listing with ID: 1981481
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981481%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [ayvens.es] INFO: Scrape type for 1981481: 1
2026-03-24 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1981481
2026-03-24 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1981481
2026-03-24 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e87b5e49-ddb3-528b-9d2f-09ca840a391d with scrape type 1
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e87b5e49-ddb3-528b-9d2f-09ca840a391d
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252Fe21d43d8f6cb4047af17b8137ebedf58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/e21d43d8f6cb4047af17b8137ebedf58/images/large/1.jpg not downloaded yet
2026-03-24 18:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 484af6ea-a864-54de-a358-cc6c00f97b8f with identifier: 1981472
2026-03-24 18:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 484af6ea-a864-54de-a358-cc6c00f97b8f with identifier: 1981472
2026-03-24 18:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 484af6ea-a864-54de-a358-cc6c00f97b8f with identifier: 1981472 to the API
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/398/31f913343a464d4b84597f68f853547f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '484af6ea-a864-54de-a358-cc6c00f97b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO',
 'odometer': 90589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484af6ea-a864-54de-a358-cc6c00f97b8f/484af6ea-a864-54de-a358-cc6c00f97b8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/398/31f913343a464d4b84597f68f853547f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TAIGO Life 1.0 TSI 81kW (110CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 81kW (110CV) DSG',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981472%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [ayvens.es] INFO: Saving data for 1981472: {'created_time': 1774377242.482299, 'last_price_update_time': 1774377242.482308, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981472') HTTP/1.1" 204 0
2026-03-24 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/348/f804bf2085dd4f41853860a501fcc71b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:02 [ayvens.es] INFO: Found listing with ID: 1981482
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981482%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [ayvens.es] INFO: Scrape type for 1981482: 1
2026-03-24 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1981482
2026-03-24 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1981482
2026-03-24 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef58058b-a80c-52bd-96d9-25c4783ef344 with scrape type 1
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef58058b-a80c-52bd-96d9-25c4783ef344
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252F40ad6e66801b46f4a3d6c16fdb853880%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/40ad6e66801b46f4a3d6c16fdb853880/images/large/1.jpg not downloaded yet
2026-03-24 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/484/addf021ae94941ef98d5273effa783a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed5c810>
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc0de46-af2b-5680-a07c-6d502dce14f5/1fc0de46-af2b-5680-a07c-6d502dce14f5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252Fb6b7e6c242d94d7685c4dd29966ee08a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/b6b7e6c242d94d7685c4dd29966ee08a/images/large/1.jpg saved to cache
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fc0de46-af2b-5680-a07c-6d502dce14f5
2026-03-24 18:34:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fc0de46-af2b-5680-a07c-6d502dce14f5, skipping ID generation
2026-03-24 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc0de46-af2b-5680-a07c-6d502dce14f5 with scrape type 1
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fc0de46-af2b-5680-a07c-6d502dce14f5 sending to next pipeline
2026-03-24 18:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1fc0de46-af2b-5680-a07c-6d502dce14f5, identifier: 1981474
2026-03-24 18:34:02 [ayvens.es] INFO: Found listing with ID: 1981483
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981483%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [ayvens.es] INFO: Scrape type for 1981483: 1
2026-03-24 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1981483
2026-03-24 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1981483
2026-03-24 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad with scrape type 1
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F529%252F40ca321c29154553b4d08ccfd3491d22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/529/40ca321c29154553b4d08ccfd3491d22/images/large/1.jpg not downloaded yet
2026-03-24 18:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1981474
2026-03-24 18:34:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1981474
2026-03-24 18:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1981474 to the API
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/b6b7e6c242d94d7685c4dd29966ee08a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris indy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fc0de46-af2b-5680-a07c-6d502dce14f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 232689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc0de46-af2b-5680-a07c-6d502dce14f5/1fc0de46-af2b-5680-a07c-6d502dce14f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/b6b7e6c242d94d7685c4dd29966ee08a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Business & Navi 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business & Navi 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981474%27 HTTP/1.1" 200 None
2026-03-24 18:34:03 [ayvens.es] INFO: Saving data for 1981474: {'created_time': 1774377243.055413, 'last_price_update_time': 1774377243.055423, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981474') HTTP/1.1" 204 0
2026-03-24 18:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/645/02153c8a94f24653b6017a91755d6c0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/901/43140e3c6bb74009b6afd5a5692bbfb2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/533/bdfbdf72583a4b67a793d2ee4cb4a0a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:03 [ayvens.es] INFO: Found listing with ID: 1981484
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981484%27 HTTP/1.1" 200 None
2026-03-24 18:34:03 [ayvens.es] INFO: Scrape type for 1981484: 1
2026-03-24 18:34:03 [ayvens.es] INFO: Extracting data for car ID: 1981484
2026-03-24 18:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf721572-e1d7-5089-9aaa-39a463d4cfb3 with identifier: 1981484
2026-03-24 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf721572-e1d7-5089-9aaa-39a463d4cfb3 with scrape type 1
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf721572-e1d7-5089-9aaa-39a463d4cfb3
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F9e7fec80b5cd4250aac46b89433175b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/9e7fec80b5cd4250aac46b89433175b5/images/large/1.jpg not downloaded yet
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee3b610>
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff2e819-62e6-57ad-a159-bc7536562961/fff2e819-62e6-57ad-a159-bc7536562961_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F348%252Ff804bf2085dd4f41853860a501fcc71b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/348/f804bf2085dd4f41853860a501fcc71b/images/large/1.jpg saved to cache
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fff2e819-62e6-57ad-a159-bc7536562961
2026-03-24 18:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fff2e819-62e6-57ad-a159-bc7536562961, skipping ID generation
2026-03-24 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff2e819-62e6-57ad-a159-bc7536562961 with scrape type 1
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fff2e819-62e6-57ad-a159-bc7536562961 sending to next pipeline
2026-03-24 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fff2e819-62e6-57ad-a159-bc7536562961, identifier: 1981476
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecf3210>
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1671e095-76a0-5ee1-8c79-6c13af3f2821/1671e095-76a0-5ee1-8c79-6c13af3f2821_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252Faddf021ae94941ef98d5273effa783a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/addf021ae94941ef98d5273effa783a6/images/large/1.jpg saved to cache
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1671e095-76a0-5ee1-8c79-6c13af3f2821
2026-03-24 18:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1671e095-76a0-5ee1-8c79-6c13af3f2821, skipping ID generation
2026-03-24 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1671e095-76a0-5ee1-8c79-6c13af3f2821 with scrape type 1
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1671e095-76a0-5ee1-8c79-6c13af3f2821 sending to next pipeline
2026-03-24 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1671e095-76a0-5ee1-8c79-6c13af3f2821, identifier: 1981473
2026-03-24 18:34:03 [ayvens.es] INFO: Found listing with ID: 1981485
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981485%27 HTTP/1.1" 200 None
2026-03-24 18:34:03 [ayvens.es] INFO: Scrape type for 1981485: 1
2026-03-24 18:34:03 [ayvens.es] INFO: Extracting data for car ID: 1981485
2026-03-24 18:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41a9b728-f123-53cd-a688-538e63b86fb3 with identifier: 1981485
2026-03-24 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41a9b728-f123-53cd-a688-538e63b86fb3 with scrape type 1
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 41a9b728-f123-53cd-a688-538e63b86fb3
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252F50d8ca67a3ca48bd8fb7d9e65faa5ac3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/50d8ca67a3ca48bd8fb7d9e65faa5ac3/images/large/1.jpg not downloaded yet
2026-03-24 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1981476
2026-03-24 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1981476
2026-03-24 18:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1981476 to the API
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/348/f804bf2085dd4f41853860a501fcc71b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Negro profundo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fff2e819-62e6-57ad-a159-bc7536562961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 67869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fff2e819-62e6-57ad-a159-bc7536562961/fff2e819-62e6-57ad-a159-bc7536562961_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/348/f804bf2085dd4f41853860a501fcc71b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON Elegance 2.0 TDI 176kW (240CV) DSG',
 'transmission': 'manual',
 'trim': 'Elegance 2.0 TDI 176kW (240CV) DSG',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981476%27 HTTP/1.1" 200 None
2026-03-24 18:34:03 [ayvens.es] INFO: Saving data for 1981476: {'created_time': 1774377243.755055, 'last_price_update_time': 1774377243.755071, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981476') HTTP/1.1" 204 0
2026-03-24 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1671e095-76a0-5ee1-8c79-6c13af3f2821 with identifier: 1981473
2026-03-24 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1671e095-76a0-5ee1-8c79-6c13af3f2821 with identifier: 1981473
2026-03-24 18:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1671e095-76a0-5ee1-8c79-6c13af3f2821 with identifier: 1981473 to the API
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/484/addf021ae94941ef98d5273effa783a6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Gris intenso',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1671e095-76a0-5ee1-8c79-6c13af3f2821',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 38322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1671e095-76a0-5ee1-8c79-6c13af3f2821/1671e095-76a0-5ee1-8c79-6c13af3f2821_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/484/addf021ae94941ef98d5273effa783a6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS Advance 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981473%27 HTTP/1.1" 200 None
2026-03-24 18:34:04 [ayvens.es] INFO: Saving data for 1981473: {'created_time': 1774377244.065632, 'last_price_update_time': 1774377244.065644, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981473') HTTP/1.1" 204 0
2026-03-24 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/015/ce22952cfd884217af89b8be4fb76738/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:04 [ayvens.es] INFO: Found listing with ID: 1981486
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981486%27 HTTP/1.1" 200 None
2026-03-24 18:34:04 [ayvens.es] INFO: Scrape type for 1981486: 1
2026-03-24 18:34:04 [ayvens.es] INFO: Extracting data for car ID: 1981486
2026-03-24 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1981486
2026-03-24 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bc041b-f307-5db5-8464-bbc595301e21 with scrape type 1
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58bc041b-f307-5db5-8464-bbc595301e21
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Feef2c2b8301e4efeb4cc500be390beb0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/eef2c2b8301e4efeb4cc500be390beb0/images/large/1.jpg not downloaded yet
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea33f50>
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c95ec5-03ba-5275-bdf0-389bd45e641f/98c95ec5-03ba-5275-bdf0-389bd45e641f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252F02153c8a94f24653b6017a91755d6c0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/02153c8a94f24653b6017a91755d6c0f/images/large/1.jpg saved to cache
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98c95ec5-03ba-5275-bdf0-389bd45e641f
2026-03-24 18:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98c95ec5-03ba-5275-bdf0-389bd45e641f, skipping ID generation
2026-03-24 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c95ec5-03ba-5275-bdf0-389bd45e641f with scrape type 1
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98c95ec5-03ba-5275-bdf0-389bd45e641f sending to next pipeline
2026-03-24 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 98c95ec5-03ba-5275-bdf0-389bd45e641f, identifier: 1981475
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee935990>
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c6e2a9-2703-54c4-94b1-1a23cae4878c/35c6e2a9-2703-54c4-94b1-1a23cae4878c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252F43140e3c6bb74009b6afd5a5692bbfb2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/43140e3c6bb74009b6afd5a5692bbfb2/images/large/1.jpg saved to cache
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35c6e2a9-2703-54c4-94b1-1a23cae4878c
2026-03-24 18:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35c6e2a9-2703-54c4-94b1-1a23cae4878c, skipping ID generation
2026-03-24 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c6e2a9-2703-54c4-94b1-1a23cae4878c with scrape type 1
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35c6e2a9-2703-54c4-94b1-1a23cae4878c sending to next pipeline
2026-03-24 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35c6e2a9-2703-54c4-94b1-1a23cae4878c, identifier: 1981478
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed5ccd0>
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc63f20-9c5c-5c87-8c2a-c10631564033/abc63f20-9c5c-5c87-8c2a-c10631564033_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252Fbdfbdf72583a4b67a793d2ee4cb4a0a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/bdfbdf72583a4b67a793d2ee4cb4a0a8/images/large/1.jpg saved to cache
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abc63f20-9c5c-5c87-8c2a-c10631564033
2026-03-24 18:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abc63f20-9c5c-5c87-8c2a-c10631564033, skipping ID generation
2026-03-24 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc63f20-9c5c-5c87-8c2a-c10631564033 with scrape type 1
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abc63f20-9c5c-5c87-8c2a-c10631564033 sending to next pipeline
2026-03-24 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: abc63f20-9c5c-5c87-8c2a-c10631564033, identifier: 1981477
2026-03-24 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/229/85d5cad74e284039b8a5e57da1811580/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:04 [ayvens.es] INFO: Found listing with ID: 1981487
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981487%27 HTTP/1.1" 200 None
2026-03-24 18:34:04 [ayvens.es] INFO: Scrape type for 1981487: 1
2026-03-24 18:34:04 [ayvens.es] INFO: Extracting data for car ID: 1981487
2026-03-24 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58 with identifier: 1981487
2026-03-24 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58 with scrape type 1
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F297%252F4eab8fbdd8084daa8f7214d645a5456b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/297/4eab8fbdd8084daa8f7214d645a5456b/images/large/1.jpg not downloaded yet
2026-03-24 18:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 98c95ec5-03ba-5275-bdf0-389bd45e641f with identifier: 1981475
2026-03-24 18:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 98c95ec5-03ba-5275-bdf0-389bd45e641f with identifier: 1981475
2026-03-24 18:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 98c95ec5-03ba-5275-bdf0-389bd45e641f with identifier: 1981475 to the API
2026-03-24 18:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/645/02153c8a94f24653b6017a91755d6c0f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '98c95ec5-03ba-5275-bdf0-389bd45e641f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 91959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c95ec5-03ba-5275-bdf0-389bd45e641f/98c95ec5-03ba-5275-bdf0-389bd45e641f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/645/02153c8a94f24653b6017a91755d6c0f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 Momentum Pro',
 'transmission': 'manual',
 'trim': '1.5 T2 Momentum Pro',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981475%27 HTTP/1.1" 200 None
2026-03-24 18:34:05 [ayvens.es] INFO: Saving data for 1981475: {'created_time': 1774377245.776074, 'last_price_update_time': 1774377245.776084, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981475') HTTP/1.1" 204 0
2026-03-24 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35c6e2a9-2703-54c4-94b1-1a23cae4878c with identifier: 1981478
2026-03-24 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35c6e2a9-2703-54c4-94b1-1a23cae4878c with identifier: 1981478
2026-03-24 18:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35c6e2a9-2703-54c4-94b1-1a23cae4878c with identifier: 1981478 to the API
2026-03-24 18:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/901/43140e3c6bb74009b6afd5a5692bbfb2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Plata luna',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '35c6e2a9-2703-54c4-94b1-1a23cae4878c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 88759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c6e2a9-2703-54c4-94b1-1a23cae4878c/35c6e2a9-2703-54c4-94b1-1a23cae4878c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/901/43140e3c6bb74009b6afd5a5692bbfb2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Luxury',
 'transmission': 'manual',
 'trim': '2.5l 220H Luxury',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981478%27 HTTP/1.1" 200 None
2026-03-24 18:34:06 [ayvens.es] INFO: Saving data for 1981478: {'created_time': 1774377246.160503, 'last_price_update_time': 1774377246.160513, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981478') HTTP/1.1" 204 0
2026-03-24 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1981477
2026-03-24 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1981477
2026-03-24 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1981477 to the API
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/533/bdfbdf72583a4b67a793d2ee4cb4a0a8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'abc63f20-9c5c-5c87-8c2a-c10631564033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 76538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc63f20-9c5c-5c87-8c2a-c10631564033/abc63f20-9c5c-5c87-8c2a-c10631564033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/533/bdfbdf72583a4b67a793d2ee4cb4a0a8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981477%27 HTTP/1.1" 200 None
2026-03-24 18:34:06 [ayvens.es] INFO: Saving data for 1981477: {'created_time': 1774377246.470759, 'last_price_update_time': 1774377246.470769, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981477') HTTP/1.1" 204 0
2026-03-24 18:34:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 2 pages/min), scraped 365 items (at 99 items/min)
2026-03-24 18:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-24 18:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/557/40ad6e66801b46f4a3d6c16fdb853880/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/548/e21d43d8f6cb4047af17b8137ebedf58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:06 [ayvens.es] INFO: Found listing with ID: 1981488
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981488%27 HTTP/1.1" 200 None
2026-03-24 18:34:06 [ayvens.es] INFO: Scrape type for 1981488: 1
2026-03-24 18:34:06 [ayvens.es] INFO: Extracting data for car ID: 1981488
2026-03-24 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1981488
2026-03-24 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with scrape type 1
2026-03-24 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252Ffc3676a67e9d4ffabf864a4ab35e3978%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/fc3676a67e9d4ffabf864a4ab35e3978/images/large/1.jpg not downloaded yet
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed5e790>
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47c47e4e-e1b3-5d77-88ce-359ac178b353/47c47e4e-e1b3-5d77-88ce-359ac178b353_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F015%252Fce22952cfd884217af89b8be4fb76738%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/015/ce22952cfd884217af89b8be4fb76738/images/large/1.jpg saved to cache
2026-03-24 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47c47e4e-e1b3-5d77-88ce-359ac178b353
2026-03-24 18:34:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47c47e4e-e1b3-5d77-88ce-359ac178b353, skipping ID generation
2026-03-24 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47c47e4e-e1b3-5d77-88ce-359ac178b353 with scrape type 1
2026-03-24 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47c47e4e-e1b3-5d77-88ce-359ac178b353 sending to next pipeline
2026-03-24 18:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 47c47e4e-e1b3-5d77-88ce-359ac178b353, identifier: 1981480
2026-03-24 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 47c47e4e-e1b3-5d77-88ce-359ac178b353 with identifier: 1981480
2026-03-24 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 47c47e4e-e1b3-5d77-88ce-359ac178b353 with identifier: 1981480
2026-03-24 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 47c47e4e-e1b3-5d77-88ce-359ac178b353 with identifier: 1981480 to the API
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/015/ce22952cfd884217af89b8be4fb76738/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '47c47e4e-e1b3-5d77-88ce-359ac178b353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 110088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47c47e4e-e1b3-5d77-88ce-359ac178b353/47c47e4e-e1b3-5d77-88ce-359ac178b353_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/015/ce22952cfd884217af89b8be4fb76738/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Emotion',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981480%27 HTTP/1.1" 200 None
2026-03-24 18:34:06 [ayvens.es] INFO: Saving data for 1981480: {'created_time': 1774377246.949663, 'last_price_update_time': 1774377246.949673, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981480') HTTP/1.1" 204 0
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1fd090>
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e73321-706b-5a65-980c-6a4e8e4bb6ee/c3e73321-706b-5a65-980c-6a4e8e4bb6ee_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252F85d5cad74e284039b8a5e57da1811580%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/85d5cad74e284039b8a5e57da1811580/images/large/1.jpg saved to cache
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee
2026-03-24 18:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3e73321-706b-5a65-980c-6a4e8e4bb6ee, skipping ID generation
2026-03-24 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee with scrape type 1
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee sending to next pipeline
2026-03-24 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3e73321-706b-5a65-980c-6a4e8e4bb6ee, identifier: 1981479
2026-03-24 18:34:07 [ayvens.es] INFO: Found listing with ID: 1981489
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981489%27 HTTP/1.1" 200 None
2026-03-24 18:34:07 [ayvens.es] INFO: Scrape type for 1981489: 1
2026-03-24 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1981489
2026-03-24 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d379f8-6e36-55a7-aa0b-a161b2d3b805 with identifier: 1981489
2026-03-24 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d379f8-6e36-55a7-aa0b-a161b2d3b805 with scrape type 1
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77d379f8-6e36-55a7-aa0b-a161b2d3b805
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252Fc97d73989e54401e9715e4b0bf3ee680%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/c97d73989e54401e9715e4b0bf3ee680/images/large/1.jpg not downloaded yet
2026-03-24 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1981479
2026-03-24 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1981479
2026-03-24 18:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1981479 to the API
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/229/85d5cad74e284039b8a5e57da1811580/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Crystal white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c3e73321-706b-5a65-980c-6a4e8e4bb6ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 58651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e73321-706b-5a65-980c-6a4e8e4bb6ee/c3e73321-706b-5a65-980c-6a4e8e4bb6ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/229/85d5cad74e284039b8a5e57da1811580/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 B3 G Plus Dark Auto',
 'transmission': 'manual',
 'trim': '2.0 B3 G Plus Dark Auto',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981479%27 HTTP/1.1" 200 None
2026-03-24 18:34:07 [ayvens.es] INFO: Saving data for 1981479: {'created_time': 1774377247.494917, 'last_price_update_time': 1774377247.494928, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981479') HTTP/1.1" 204 0
2026-03-24 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/529/40ca321c29154553b4d08ccfd3491d22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea02d90>
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef58058b-a80c-52bd-96d9-25c4783ef344/ef58058b-a80c-52bd-96d9-25c4783ef344_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252F40ad6e66801b46f4a3d6c16fdb853880%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/40ad6e66801b46f4a3d6c16fdb853880/images/large/1.jpg saved to cache
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef58058b-a80c-52bd-96d9-25c4783ef344
2026-03-24 18:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef58058b-a80c-52bd-96d9-25c4783ef344, skipping ID generation
2026-03-24 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef58058b-a80c-52bd-96d9-25c4783ef344 with scrape type 1
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef58058b-a80c-52bd-96d9-25c4783ef344 sending to next pipeline
2026-03-24 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef58058b-a80c-52bd-96d9-25c4783ef344, identifier: 1981482
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f0fd0>
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e87b5e49-ddb3-528b-9d2f-09ca840a391d/e87b5e49-ddb3-528b-9d2f-09ca840a391d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252Fe21d43d8f6cb4047af17b8137ebedf58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/e21d43d8f6cb4047af17b8137ebedf58/images/large/1.jpg saved to cache
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e87b5e49-ddb3-528b-9d2f-09ca840a391d
2026-03-24 18:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e87b5e49-ddb3-528b-9d2f-09ca840a391d, skipping ID generation
2026-03-24 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e87b5e49-ddb3-528b-9d2f-09ca840a391d with scrape type 1
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e87b5e49-ddb3-528b-9d2f-09ca840a391d sending to next pipeline
2026-03-24 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e87b5e49-ddb3-528b-9d2f-09ca840a391d, identifier: 1981481
2026-03-24 18:34:07 [ayvens.es] INFO: Found listing with ID: 1981490
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981490%27 HTTP/1.1" 200 None
2026-03-24 18:34:07 [ayvens.es] INFO: Scrape type for 1981490: 1
2026-03-24 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1981490
2026-03-24 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1981490
2026-03-24 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5d105b-fc41-5d33-a476-55af0a1ae503 with scrape type 1
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da5d105b-fc41-5d33-a476-55af0a1ae503
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F60b7b3e4e8324f44909ec4924f431775%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/60b7b3e4e8324f44909ec4924f431775/images/large/1.jpg not downloaded yet
2026-03-24 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1981482
2026-03-24 18:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1981482
2026-03-24 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1981482 to the API
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/557/40ad6e66801b46f4a3d6c16fdb853880/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris manganeso metal',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef58058b-a80c-52bd-96d9-25c4783ef344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 102588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef58058b-a80c-52bd-96d9-25c4783ef344/ef58058b-a80c-52bd-96d9-25c4783ef344_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/557/40ad6e66801b46f4a3d6c16fdb853880/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981482%27 HTTP/1.1" 200 None
2026-03-24 18:34:08 [ayvens.es] INFO: Saving data for 1981482: {'created_time': 1774377248.328039, 'last_price_update_time': 1774377248.328053, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981482') HTTP/1.1" 204 0
2026-03-24 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1981481
2026-03-24 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1981481
2026-03-24 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1981481 to the API
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/548/e21d43d8f6cb4047af17b8137ebedf58/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Gris grafito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e87b5e49-ddb3-528b-9d2f-09ca840a391d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 100229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e87b5e49-ddb3-528b-9d2f-09ca840a391d/e87b5e49-ddb3-528b-9d2f-09ca840a391d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/548/e21d43d8f6cb4047af17b8137ebedf58/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981481%27 HTTP/1.1" 200 None
2026-03-24 18:34:08 [ayvens.es] INFO: Saving data for 1981481: {'created_time': 1774377248.6519, 'last_price_update_time': 1774377248.651914, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981481') HTTP/1.1" 204 0
2026-03-24 18:34:08 [ayvens.es] INFO: Found listing with ID: 1981491
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981491%27 HTTP/1.1" 200 None
2026-03-24 18:34:08 [ayvens.es] INFO: Scrape type for 1981491: 1
2026-03-24 18:34:08 [ayvens.es] INFO: Extracting data for car ID: 1981491
2026-03-24 18:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1981491
2026-03-24 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101ae601-de13-5d20-ac7d-5ae40d032fc5 with scrape type 1
2026-03-24 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 101ae601-de13-5d20-ac7d-5ae40d032fc5
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F3cef0f8a0d4f4e5bb49a74a3da0f530d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/3cef0f8a0d4f4e5bb49a74a3da0f530d/images/large/1.jpg not downloaded yet
2026-03-24 18:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/186/9e7fec80b5cd4250aac46b89433175b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6c7c10>
2026-03-24 18:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629ae7b-4d12-5fa6-bdba-9f23580273ad/0629ae7b-4d12-5fa6-bdba-9f23580273ad_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F529%252F40ca321c29154553b4d08ccfd3491d22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/529/40ca321c29154553b4d08ccfd3491d22/images/large/1.jpg saved to cache
2026-03-24 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad
2026-03-24 18:34:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0629ae7b-4d12-5fa6-bdba-9f23580273ad, skipping ID generation
2026-03-24 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad with scrape type 1
2026-03-24 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad sending to next pipeline
2026-03-24 18:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0629ae7b-4d12-5fa6-bdba-9f23580273ad, identifier: 1981483
2026-03-24 18:34:08 [ayvens.es] INFO: Found listing with ID: 1981492
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981492%27 HTTP/1.1" 200 None
2026-03-24 18:34:08 [ayvens.es] INFO: Scrape type for 1981492: 1
2026-03-24 18:34:08 [ayvens.es] INFO: Extracting data for car ID: 1981492
2026-03-24 18:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1981492
2026-03-24 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa4a992-7df2-51d3-a473-aa0df1df8e0b with scrape type 1
2026-03-24 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efa4a992-7df2-51d3-a473-aa0df1df8e0b
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F0ec36f95acae4351980f1dfd67c91930%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/0ec36f95acae4351980f1dfd67c91930/images/large/1.jpg not downloaded yet
2026-03-24 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1981483
2026-03-24 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1981483
2026-03-24 18:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1981483 to the API
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/529/40ca321c29154553b4d08ccfd3491d22/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Negro metalizado',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0629ae7b-4d12-5fa6-bdba-9f23580273ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'S60',
 'odometer': 80019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0629ae7b-4d12-5fa6-bdba-9f23580273ad/0629ae7b-4d12-5fa6-bdba-9f23580273ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/529/40ca321c29154553b4d08ccfd3491d22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO S60 B4(G) FWD Momentum Pro aut',
 'transmission': 'manual',
 'trim': 'B4(G) FWD Momentum Pro aut',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981483%27 HTTP/1.1" 200 None
2026-03-24 18:34:09 [ayvens.es] INFO: Saving data for 1981483: {'created_time': 1774377249.706035, 'last_price_update_time': 1774377249.706046, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981483') HTTP/1.1" 204 0
2026-03-24 18:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/eef2c2b8301e4efeb4cc500be390beb0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/069/50d8ca67a3ca48bd8fb7d9e65faa5ac3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:09 [ayvens.es] INFO: Found listing with ID: 1981493
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981493%27 HTTP/1.1" 200 None
2026-03-24 18:34:09 [ayvens.es] INFO: Scrape type for 1981493: 1
2026-03-24 18:34:09 [ayvens.es] INFO: Extracting data for car ID: 1981493
2026-03-24 18:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1981493
2026-03-24 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba17eae-5fde-57ea-9e80-962dd8cda078 with scrape type 1
2026-03-24 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ba17eae-5fde-57ea-9e80-962dd8cda078
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F459%252F0ef7e643f2b245dbb075e967faf3b754%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/459/0ef7e643f2b245dbb075e967faf3b754/images/large/1.jpg not downloaded yet
2026-03-24 18:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/297/4eab8fbdd8084daa8f7214d645a5456b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed4b3d0>
2026-03-24 18:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf721572-e1d7-5089-9aaa-39a463d4cfb3/bf721572-e1d7-5089-9aaa-39a463d4cfb3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F9e7fec80b5cd4250aac46b89433175b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/9e7fec80b5cd4250aac46b89433175b5/images/large/1.jpg saved to cache
2026-03-24 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf721572-e1d7-5089-9aaa-39a463d4cfb3
2026-03-24 18:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf721572-e1d7-5089-9aaa-39a463d4cfb3, skipping ID generation
2026-03-24 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf721572-e1d7-5089-9aaa-39a463d4cfb3 with scrape type 1
2026-03-24 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf721572-e1d7-5089-9aaa-39a463d4cfb3 sending to next pipeline
2026-03-24 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf721572-e1d7-5089-9aaa-39a463d4cfb3, identifier: 1981484
2026-03-24 18:34:10 [ayvens.es] INFO: Found listing with ID: 1981494
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981494%27 HTTP/1.1" 200 None
2026-03-24 18:34:10 [ayvens.es] INFO: Scrape type for 1981494: 1
2026-03-24 18:34:10 [ayvens.es] INFO: Extracting data for car ID: 1981494
2026-03-24 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1981494
2026-03-24 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc86e80-3c9c-522c-a6b1-829a4275668e with scrape type 1
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4bc86e80-3c9c-522c-a6b1-829a4275668e
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F272aa6da5f584bce8f2385142d57b6f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/272aa6da5f584bce8f2385142d57b6f0/images/large/1.jpg not downloaded yet
2026-03-24 18:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf721572-e1d7-5089-9aaa-39a463d4cfb3 with identifier: 1981484
2026-03-24 18:34:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf721572-e1d7-5089-9aaa-39a463d4cfb3 with identifier: 1981484
2026-03-24 18:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf721572-e1d7-5089-9aaa-39a463d4cfb3 with identifier: 1981484 to the API
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/186/9e7fec80b5cd4250aac46b89433175b5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Negro onyx metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf721572-e1d7-5089-9aaa-39a463d4cfb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 72896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf721572-e1d7-5089-9aaa-39a463d4cfb3/bf721572-e1d7-5089-9aaa-39a463d4cfb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/186/9e7fec80b5cd4250aac46b89433175b5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 (O) 2.0 B4 D AWD Inscription Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 B4 D AWD Inscription Auto',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981484%27 HTTP/1.1" 200 None
2026-03-24 18:34:10 [ayvens.es] INFO: Saving data for 1981484: {'created_time': 1774377250.361327, 'last_price_update_time': 1774377250.361337, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981484') HTTP/1.1" 204 0
2026-03-24 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/303/fc3676a67e9d4ffabf864a4ab35e3978/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:10 [ayvens.es] INFO: Found listing with ID: 1981495
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981495%27 HTTP/1.1" 200 None
2026-03-24 18:34:10 [ayvens.es] INFO: Scrape type for 1981495: 1
2026-03-24 18:34:10 [ayvens.es] INFO: Extracting data for car ID: 1981495
2026-03-24 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1981495
2026-03-24 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477f3e37-ff75-5318-abdd-0850833645a9 with scrape type 1
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 477f3e37-ff75-5318-abdd-0850833645a9
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F0f621ca1b8b641bfbb49e2f3ff863e7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/0f621ca1b8b641bfbb49e2f3ff863e7d/images/large/1.jpg not downloaded yet
2026-03-24 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/60b7b3e4e8324f44909ec4924f431775/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7ceed0>
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bc041b-f307-5db5-8464-bbc595301e21/58bc041b-f307-5db5-8464-bbc595301e21_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Feef2c2b8301e4efeb4cc500be390beb0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/eef2c2b8301e4efeb4cc500be390beb0/images/large/1.jpg saved to cache
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58bc041b-f307-5db5-8464-bbc595301e21
2026-03-24 18:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58bc041b-f307-5db5-8464-bbc595301e21, skipping ID generation
2026-03-24 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bc041b-f307-5db5-8464-bbc595301e21 with scrape type 1
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58bc041b-f307-5db5-8464-bbc595301e21 sending to next pipeline
2026-03-24 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 58bc041b-f307-5db5-8464-bbc595301e21, identifier: 1981486
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6f7e50>
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a9b728-f123-53cd-a688-538e63b86fb3/41a9b728-f123-53cd-a688-538e63b86fb3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252F50d8ca67a3ca48bd8fb7d9e65faa5ac3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/50d8ca67a3ca48bd8fb7d9e65faa5ac3/images/large/1.jpg saved to cache
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41a9b728-f123-53cd-a688-538e63b86fb3
2026-03-24 18:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41a9b728-f123-53cd-a688-538e63b86fb3, skipping ID generation
2026-03-24 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41a9b728-f123-53cd-a688-538e63b86fb3 with scrape type 1
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41a9b728-f123-53cd-a688-538e63b86fb3 sending to next pipeline
2026-03-24 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 41a9b728-f123-53cd-a688-538e63b86fb3, identifier: 1981485
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee907050>
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660a8b70-a316-5fa5-9b3c-9e7be7fc5b58/660a8b70-a316-5fa5-9b3c-9e7be7fc5b58_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F297%252F4eab8fbdd8084daa8f7214d645a5456b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/297/4eab8fbdd8084daa8f7214d645a5456b/images/large/1.jpg saved to cache
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58
2026-03-24 18:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58, skipping ID generation
2026-03-24 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58 with scrape type 1
2026-03-24 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58 sending to next pipeline
2026-03-24 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58, identifier: 1981487
2026-03-24 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/899/c97d73989e54401e9715e4b0bf3ee680/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:10 [ayvens.es] INFO: Found listing with ID: 1981496
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981496%27 HTTP/1.1" 200 None
2026-03-24 18:34:11 [ayvens.es] INFO: Scrape type for 1981496: 1
2026-03-24 18:34:11 [ayvens.es] INFO: Extracting data for car ID: 1981496
2026-03-24 18:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed00139-9aac-5df5-852d-18daddeeaa52 with identifier: 1981496
2026-03-24 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed00139-9aac-5df5-852d-18daddeeaa52 with scrape type 1
2026-03-24 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0ed00139-9aac-5df5-852d-18daddeeaa52
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F139%252F79d8011d8697489daf3f12a622010bc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/139/79d8011d8697489daf3f12a622010bc9/images/large/1.jpg not downloaded yet
2026-03-24 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1981486
2026-03-24 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1981486
2026-03-24 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1981486 to the API
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/eef2c2b8301e4efeb4cc500be390beb0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '58bc041b-f307-5db5-8464-bbc595301e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 126960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bc041b-f307-5db5-8464-bbc595301e21/58bc041b-f307-5db5-8464-bbc595301e21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/eef2c2b8301e4efeb4cc500be390beb0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981486%27 HTTP/1.1" 200 None
2026-03-24 18:34:11 [ayvens.es] INFO: Saving data for 1981486: {'created_time': 1774377251.330652, 'last_price_update_time': 1774377251.330678, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981486') HTTP/1.1" 204 0
2026-03-24 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 41a9b728-f123-53cd-a688-538e63b86fb3 with identifier: 1981485
2026-03-24 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 41a9b728-f123-53cd-a688-538e63b86fb3 with identifier: 1981485
2026-03-24 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 41a9b728-f123-53cd-a688-538e63b86fb3 with identifier: 1981485 to the API
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/069/50d8ca67a3ca48bd8fb7d9e65faa5ac3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '41a9b728-f123-53cd-a688-538e63b86fb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 105623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a9b728-f123-53cd-a688-538e63b86fb3/41a9b728-f123-53cd-a688-538e63b86fb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/069/50d8ca67a3ca48bd8fb7d9e65faa5ac3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Advance 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981485%27 HTTP/1.1" 200 None
2026-03-24 18:34:11 [ayvens.es] INFO: Saving data for 1981485: {'created_time': 1774377251.631053, 'last_price_update_time': 1774377251.631066, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981485') HTTP/1.1" 204 0
2026-03-24 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58 with identifier: 1981487
2026-03-24 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58 with identifier: 1981487
2026-03-24 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 660a8b70-a316-5fa5-9b3c-9e7be7fc5b58 with identifier: 1981487 to the API
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/297/4eab8fbdd8084daa8f7214d645a5456b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '660a8b70-a316-5fa5-9b3c-9e7be7fc5b58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 57268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660a8b70-a316-5fa5-9b3c-9e7be7fc5b58/660a8b70-a316-5fa5-9b3c-9e7be7fc5b58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/297/4eab8fbdd8084daa8f7214d645a5456b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981487%27 HTTP/1.1" 200 None
2026-03-24 18:34:12 [ayvens.es] INFO: Saving data for 1981487: {'created_time': 1774377252.029989, 'last_price_update_time': 1774377252.029999, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981487') HTTP/1.1" 204 0
2026-03-24 18:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/781/3cef0f8a0d4f4e5bb49a74a3da0f530d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:12 [ayvens.es] INFO: Found listing with ID: 1981497
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981497%27 HTTP/1.1" 200 None
2026-03-24 18:34:12 [ayvens.es] INFO: Scrape type for 1981497: 1
2026-03-24 18:34:12 [ayvens.es] INFO: Extracting data for car ID: 1981497
2026-03-24 18:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1981497
2026-03-24 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1794127-7af2-5157-9935-4d62cd87fc27 with scrape type 1
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1794127-7af2-5157-9935-4d62cd87fc27
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F110c6af954cc4a31905006faca031d98%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/110c6af954cc4a31905006faca031d98/images/large/1.jpg not downloaded yet
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee904d10>
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a407b-ca52-5c7d-a1aa-daeaa044399c/9b7a407b-ca52-5c7d-a1aa-daeaa044399c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252Ffc3676a67e9d4ffabf864a4ab35e3978%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/fc3676a67e9d4ffabf864a4ab35e3978/images/large/1.jpg saved to cache
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c
2026-03-24 18:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c, skipping ID generation
2026-03-24 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with scrape type 1
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c sending to next pipeline
2026-03-24 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c, identifier: 1981488
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb09dd0>
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5d105b-fc41-5d33-a476-55af0a1ae503/da5d105b-fc41-5d33-a476-55af0a1ae503_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F60b7b3e4e8324f44909ec4924f431775%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/60b7b3e4e8324f44909ec4924f431775/images/large/1.jpg saved to cache
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da5d105b-fc41-5d33-a476-55af0a1ae503
2026-03-24 18:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da5d105b-fc41-5d33-a476-55af0a1ae503, skipping ID generation
2026-03-24 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5d105b-fc41-5d33-a476-55af0a1ae503 with scrape type 1
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da5d105b-fc41-5d33-a476-55af0a1ae503 sending to next pipeline
2026-03-24 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da5d105b-fc41-5d33-a476-55af0a1ae503, identifier: 1981490
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6a2810>
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77d379f8-6e36-55a7-aa0b-a161b2d3b805/77d379f8-6e36-55a7-aa0b-a161b2d3b805_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252Fc97d73989e54401e9715e4b0bf3ee680%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/c97d73989e54401e9715e4b0bf3ee680/images/large/1.jpg saved to cache
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77d379f8-6e36-55a7-aa0b-a161b2d3b805
2026-03-24 18:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77d379f8-6e36-55a7-aa0b-a161b2d3b805, skipping ID generation
2026-03-24 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d379f8-6e36-55a7-aa0b-a161b2d3b805 with scrape type 1
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77d379f8-6e36-55a7-aa0b-a161b2d3b805 sending to next pipeline
2026-03-24 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77d379f8-6e36-55a7-aa0b-a161b2d3b805, identifier: 1981489
2026-03-24 18:34:12 [ayvens.es] INFO: Found listing with ID: 1981498
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981498%27 HTTP/1.1" 200 None
2026-03-24 18:34:12 [ayvens.es] INFO: Scrape type for 1981498: 1
2026-03-24 18:34:12 [ayvens.es] INFO: Extracting data for car ID: 1981498
2026-03-24 18:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1981498
2026-03-24 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6b271d-fc2d-5ee1-8855-f910dee21907 with scrape type 1
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee6b271d-fc2d-5ee1-8855-f910dee21907
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F34c908343d244406ad6cd8c60d0d1d91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/34c908343d244406ad6cd8c60d0d1d91/images/large/1.jpg not downloaded yet
2026-03-24 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1981488
2026-03-24 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1981488
2026-03-24 18:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1981488 to the API
2026-03-24 18:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/303/fc3676a67e9d4ffabf864a4ab35e3978/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9b7a407b-ca52-5c7d-a1aa-daeaa044399c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 87258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a407b-ca52-5c7d-a1aa-daeaa044399c/9b7a407b-ca52-5c7d-a1aa-daeaa044399c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/303/fc3676a67e9d4ffabf864a4ab35e3978/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981488%27 HTTP/1.1" 200 None
2026-03-24 18:34:13 [ayvens.es] INFO: Saving data for 1981488: {'created_time': 1774377253.141087, 'last_price_update_time': 1774377253.141102, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981488') HTTP/1.1" 204 0
2026-03-24 18:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1981490
2026-03-24 18:34:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1981490
2026-03-24 18:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1981490 to the API
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/60b7b3e4e8324f44909ec4924f431775/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da5d105b-fc41-5d33-a476-55af0a1ae503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'RAPID',
 'odometer': 119496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5d105b-fc41-5d33-a476-55af0a1ae503/da5d105b-fc41-5d33-a476-55af0a1ae503_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/60b7b3e4e8324f44909ec4924f431775/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA RAPID 1.4 TDI CR 66KW (90cv) Like Spaceback',
 'transmission': 'manual',
 'trim': '1.4 TDI CR 66KW (90cv) Like Spaceback',
 'vin': None,
 'year': 2018}
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981490%27 HTTP/1.1" 200 None
2026-03-24 18:34:13 [ayvens.es] INFO: Saving data for 1981490: {'created_time': 1774377253.589505, 'last_price_update_time': 1774377253.589515, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981490') HTTP/1.1" 204 0
2026-03-24 18:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77d379f8-6e36-55a7-aa0b-a161b2d3b805 with identifier: 1981489
2026-03-24 18:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77d379f8-6e36-55a7-aa0b-a161b2d3b805 with identifier: 1981489
2026-03-24 18:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77d379f8-6e36-55a7-aa0b-a161b2d3b805 with identifier: 1981489 to the API
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/899/c97d73989e54401e9715e4b0bf3ee680/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '77d379f8-6e36-55a7-aa0b-a161b2d3b805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 91474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77d379f8-6e36-55a7-aa0b-a161b2d3b805/77d379f8-6e36-55a7-aa0b-a161b2d3b805_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/899/c97d73989e54401e9715e4b0bf3ee680/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 85kW (115CV) Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) Ambition',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981489%27 HTTP/1.1" 200 None
2026-03-24 18:34:13 [ayvens.es] INFO: Saving data for 1981489: {'created_time': 1774377253.888314, 'last_price_update_time': 1774377253.888325, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981489') HTTP/1.1" 204 0
2026-03-24 18:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/057/0ec36f95acae4351980f1dfd67c91930/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/459/0ef7e643f2b245dbb075e967faf3b754/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:13 [ayvens.es] INFO: Found listing with ID: 1981499
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981499%27 HTTP/1.1" 200 None
2026-03-24 18:34:13 [ayvens.es] INFO: Scrape type for 1981499: 1
2026-03-24 18:34:13 [ayvens.es] INFO: Extracting data for car ID: 1981499
2026-03-24 18:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c540198b-6a60-5e34-8ef8-e3bfbbc4bf98 with identifier: 1981499
2026-03-24 18:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c540198b-6a60-5e34-8ef8-e3bfbbc4bf98 with scrape type 1
2026-03-24 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c540198b-6a60-5e34-8ef8-e3bfbbc4bf98
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252Fc08d177beb2948daaaebbc12535de825%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/c08d177beb2948daaaebbc12535de825/images/large/1.jpg not downloaded yet
2026-03-24 18:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee858050>
2026-03-24 18:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101ae601-de13-5d20-ac7d-5ae40d032fc5/101ae601-de13-5d20-ac7d-5ae40d032fc5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F3cef0f8a0d4f4e5bb49a74a3da0f530d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/3cef0f8a0d4f4e5bb49a74a3da0f530d/images/large/1.jpg saved to cache
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 101ae601-de13-5d20-ac7d-5ae40d032fc5
2026-03-24 18:34:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 101ae601-de13-5d20-ac7d-5ae40d032fc5, skipping ID generation
2026-03-24 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101ae601-de13-5d20-ac7d-5ae40d032fc5 with scrape type 1
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 101ae601-de13-5d20-ac7d-5ae40d032fc5 sending to next pipeline
2026-03-24 18:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 101ae601-de13-5d20-ac7d-5ae40d032fc5, identifier: 1981491
2026-03-24 18:34:14 [ayvens.es] INFO: Found listing with ID: 1981500
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981500%27 HTTP/1.1" 200 None
2026-03-24 18:34:14 [ayvens.es] INFO: Scrape type for 1981500: 1
2026-03-24 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1981500
2026-03-24 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fb1d0e8-3c37-54e2-a931-b7a41b43732b with identifier: 1981500
2026-03-24 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fb1d0e8-3c37-54e2-a931-b7a41b43732b with scrape type 1
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3fb1d0e8-3c37-54e2-a931-b7a41b43732b
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F882%252F97b066ad804d4042a3a5ee5eeac1c6e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/882/97b066ad804d4042a3a5ee5eeac1c6e4/images/large/1.jpg not downloaded yet
2026-03-24 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1981491
2026-03-24 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1981491
2026-03-24 18:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1981491 to the API
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/781/3cef0f8a0d4f4e5bb49a74a3da0f530d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Rojo intenso metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '101ae601-de13-5d20-ac7d-5ae40d032fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 103068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101ae601-de13-5d20-ac7d-5ae40d032fc5/101ae601-de13-5d20-ac7d-5ae40d032fc5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/781/3cef0f8a0d4f4e5bb49a74a3da0f530d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV) Variant',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV) Variant',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981491%27 HTTP/1.1" 200 None
2026-03-24 18:34:14 [ayvens.es] INFO: Saving data for 1981491: {'created_time': 1774377254.413013, 'last_price_update_time': 1774377254.413023, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981491') HTTP/1.1" 204 0
2026-03-24 18:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/272aa6da5f584bce8f2385142d57b6f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:14 [ayvens.es] INFO: Found listing with ID: 1981501
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981501%27 HTTP/1.1" 200 None
2026-03-24 18:34:14 [ayvens.es] INFO: Scrape type for 1981501: 1
2026-03-24 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1981501
2026-03-24 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d25fb5f3-f2ff-5a01-97c9-c89a74370780 with identifier: 1981501
2026-03-24 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d25fb5f3-f2ff-5a01-97c9-c89a74370780 with scrape type 1
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d25fb5f3-f2ff-5a01-97c9-c89a74370780
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252F01b5f9dc950c46468e89b691a2206442%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/01b5f9dc950c46468e89b691a2206442/images/large/1.jpg not downloaded yet
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eebb6e50>
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa4a992-7df2-51d3-a473-aa0df1df8e0b/efa4a992-7df2-51d3-a473-aa0df1df8e0b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F0ec36f95acae4351980f1dfd67c91930%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/0ec36f95acae4351980f1dfd67c91930/images/large/1.jpg saved to cache
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efa4a992-7df2-51d3-a473-aa0df1df8e0b
2026-03-24 18:34:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efa4a992-7df2-51d3-a473-aa0df1df8e0b, skipping ID generation
2026-03-24 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa4a992-7df2-51d3-a473-aa0df1df8e0b with scrape type 1
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efa4a992-7df2-51d3-a473-aa0df1df8e0b sending to next pipeline
2026-03-24 18:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: efa4a992-7df2-51d3-a473-aa0df1df8e0b, identifier: 1981492
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee85a610>
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba17eae-5fde-57ea-9e80-962dd8cda078/9ba17eae-5fde-57ea-9e80-962dd8cda078_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F459%252F0ef7e643f2b245dbb075e967faf3b754%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/459/0ef7e643f2b245dbb075e967faf3b754/images/large/1.jpg saved to cache
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ba17eae-5fde-57ea-9e80-962dd8cda078
2026-03-24 18:34:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ba17eae-5fde-57ea-9e80-962dd8cda078, skipping ID generation
2026-03-24 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba17eae-5fde-57ea-9e80-962dd8cda078 with scrape type 1
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ba17eae-5fde-57ea-9e80-962dd8cda078 sending to next pipeline
2026-03-24 18:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ba17eae-5fde-57ea-9e80-962dd8cda078, identifier: 1981493
2026-03-24 18:34:14 [ayvens.es] INFO: Found listing with ID: 1981502
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981502%27 HTTP/1.1" 200 None
2026-03-24 18:34:14 [ayvens.es] INFO: Scrape type for 1981502: 1
2026-03-24 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1981502
2026-03-24 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0395a7f-39d5-5dc6-8866-75cca68c500a with identifier: 1981502
2026-03-24 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0395a7f-39d5-5dc6-8866-75cca68c500a with scrape type 1
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f0395a7f-39d5-5dc6-8866-75cca68c500a
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252F1cef2e5de44e4c4cab3fec8cd2cd80e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/1cef2e5de44e4c4cab3fec8cd2cd80e5/images/large/1.jpg not downloaded yet
2026-03-24 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1981492
2026-03-24 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1981492
2026-03-24 18:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1981492 to the API
2026-03-24 18:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/057/0ec36f95acae4351980f1dfd67c91930/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'efa4a992-7df2-51d3-a473-aa0df1df8e0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 59951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa4a992-7df2-51d3-a473-aa0df1df8e0b/efa4a992-7df2-51d3-a473-aa0df1df8e0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/057/0ec36f95acae4351980f1dfd67c91930/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON Elegance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Elegance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981492%27 HTTP/1.1" 200 None
2026-03-24 18:34:15 [ayvens.es] INFO: Saving data for 1981492: {'created_time': 1774377255.125686, 'last_price_update_time': 1774377255.125697, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981492') HTTP/1.1" 204 0
2026-03-24 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1981493
2026-03-24 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1981493
2026-03-24 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1981493 to the API
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/459/0ef7e643f2b245dbb075e967faf3b754/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Denim blue m',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9ba17eae-5fde-57ea-9e80-962dd8cda078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 176970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ba17eae-5fde-57ea-9e80-962dd8cda078/9ba17eae-5fde-57ea-9e80-962dd8cda078_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/459/0ef7e643f2b245dbb075e967faf3b754/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 B5 D AWD Momentum Pro Auto',
 'transmission': 'manual',
 'trim': '2.0 B5 D AWD Momentum Pro Auto',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981493%27 HTTP/1.1" 200 None
2026-03-24 18:34:15 [ayvens.es] INFO: Saving data for 1981493: {'created_time': 1774377255.502842, 'last_price_update_time': 1774377255.502852, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981493') HTTP/1.1" 204 0
2026-03-24 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/809/0f621ca1b8b641bfbb49e2f3ff863e7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/139/79d8011d8697489daf3f12a622010bc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/110c6af954cc4a31905006faca031d98/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:15 [ayvens.es] INFO: Found listing with ID: 1981503
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981503%27 HTTP/1.1" 200 None
2026-03-24 18:34:15 [ayvens.es] INFO: Scrape type for 1981503: 1
2026-03-24 18:34:15 [ayvens.es] INFO: Extracting data for car ID: 1981503
2026-03-24 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1981503
2026-03-24 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5636adce-2449-531a-b464-5aded1c14884 with scrape type 1
2026-03-24 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5636adce-2449-531a-b464-5aded1c14884
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F560%252F1871fc96820e4a6c9e6348fb382d5665%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/560/1871fc96820e4a6c9e6348fb382d5665/images/large/1.jpg not downloaded yet
2026-03-24 18:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea08050>
2026-03-24 18:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc86e80-3c9c-522c-a6b1-829a4275668e/4bc86e80-3c9c-522c-a6b1-829a4275668e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F272aa6da5f584bce8f2385142d57b6f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/272aa6da5f584bce8f2385142d57b6f0/images/large/1.jpg saved to cache
2026-03-24 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bc86e80-3c9c-522c-a6b1-829a4275668e
2026-03-24 18:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bc86e80-3c9c-522c-a6b1-829a4275668e, skipping ID generation
2026-03-24 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc86e80-3c9c-522c-a6b1-829a4275668e with scrape type 1
2026-03-24 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bc86e80-3c9c-522c-a6b1-829a4275668e sending to next pipeline
2026-03-24 18:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4bc86e80-3c9c-522c-a6b1-829a4275668e, identifier: 1981494
2026-03-24 18:34:15 [ayvens.es] INFO: Found listing with ID: 1981504
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981504%27 HTTP/1.1" 200 None
2026-03-24 18:34:15 [ayvens.es] INFO: Scrape type for 1981504: 1
2026-03-24 18:34:15 [ayvens.es] INFO: Extracting data for car ID: 1981504
2026-03-24 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1981504
2026-03-24 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d09e721-a595-5d2e-967a-89a270e45bd6 with scrape type 1
2026-03-24 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8d09e721-a595-5d2e-967a-89a270e45bd6
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F6fe1c2d63df441cf8b1421763088af6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/6fe1c2d63df441cf8b1421763088af6d/images/large/1.jpg not downloaded yet
2026-03-24 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1981494
2026-03-24 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1981494
2026-03-24 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1981494 to the API
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/272aa6da5f584bce8f2385142d57b6f0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4bc86e80-3c9c-522c-a6b1-829a4275668e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 107387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc86e80-3c9c-522c-a6b1-829a4275668e/4bc86e80-3c9c-522c-a6b1-829a4275668e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/272aa6da5f584bce8f2385142d57b6f0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981494%27 HTTP/1.1" 200 None
2026-03-24 18:34:16 [ayvens.es] INFO: Saving data for 1981494: {'created_time': 1774377256.24102, 'last_price_update_time': 1774377256.241034, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981494') HTTP/1.1" 204 0
2026-03-24 18:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/103/c08d177beb2948daaaebbc12535de825/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:16 [ayvens.es] INFO: Found listing with ID: 1981505
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981505%27 HTTP/1.1" 200 None
2026-03-24 18:34:16 [ayvens.es] INFO: Scrape type for 1981505: 1
2026-03-24 18:34:16 [ayvens.es] INFO: Extracting data for car ID: 1981505
2026-03-24 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1981505
2026-03-24 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c56427-74e0-594a-94cf-9905e7323d28 with scrape type 1
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77c56427-74e0-594a-94cf-9905e7323d28
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252F7084fc8297824ea9bef097d447e45af8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/7084fc8297824ea9bef097d447e45af8/images/large/1.jpg not downloaded yet
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7d5110>
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477f3e37-ff75-5318-abdd-0850833645a9/477f3e37-ff75-5318-abdd-0850833645a9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F0f621ca1b8b641bfbb49e2f3ff863e7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/0f621ca1b8b641bfbb49e2f3ff863e7d/images/large/1.jpg saved to cache
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 477f3e37-ff75-5318-abdd-0850833645a9
2026-03-24 18:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 477f3e37-ff75-5318-abdd-0850833645a9, skipping ID generation
2026-03-24 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477f3e37-ff75-5318-abdd-0850833645a9 with scrape type 1
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 477f3e37-ff75-5318-abdd-0850833645a9 sending to next pipeline
2026-03-24 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 477f3e37-ff75-5318-abdd-0850833645a9, identifier: 1981495
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eec95c10>
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed00139-9aac-5df5-852d-18daddeeaa52/0ed00139-9aac-5df5-852d-18daddeeaa52_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F139%252F79d8011d8697489daf3f12a622010bc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/139/79d8011d8697489daf3f12a622010bc9/images/large/1.jpg saved to cache
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ed00139-9aac-5df5-852d-18daddeeaa52
2026-03-24 18:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ed00139-9aac-5df5-852d-18daddeeaa52, skipping ID generation
2026-03-24 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed00139-9aac-5df5-852d-18daddeeaa52 with scrape type 1
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ed00139-9aac-5df5-852d-18daddeeaa52 sending to next pipeline
2026-03-24 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0ed00139-9aac-5df5-852d-18daddeeaa52, identifier: 1981496
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee872710>
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1794127-7af2-5157-9935-4d62cd87fc27/b1794127-7af2-5157-9935-4d62cd87fc27_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F110c6af954cc4a31905006faca031d98%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/110c6af954cc4a31905006faca031d98/images/large/1.jpg saved to cache
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1794127-7af2-5157-9935-4d62cd87fc27
2026-03-24 18:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1794127-7af2-5157-9935-4d62cd87fc27, skipping ID generation
2026-03-24 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1794127-7af2-5157-9935-4d62cd87fc27 with scrape type 1
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1794127-7af2-5157-9935-4d62cd87fc27 sending to next pipeline
2026-03-24 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1794127-7af2-5157-9935-4d62cd87fc27, identifier: 1981497
2026-03-24 18:34:16 [ayvens.es] INFO: Found listing with ID: 1981506
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981506%27 HTTP/1.1" 200 None
2026-03-24 18:34:16 [ayvens.es] INFO: Scrape type for 1981506: 1
2026-03-24 18:34:16 [ayvens.es] INFO: Extracting data for car ID: 1981506
2026-03-24 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1981506
2026-03-24 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with scrape type 1
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F052%252F0898393ce63446c8895f7c9679dfab01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/052/0898393ce63446c8895f7c9679dfab01/images/large/1.jpg not downloaded yet
2026-03-24 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1981495
2026-03-24 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1981495
2026-03-24 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1981495 to the API
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/809/0f621ca1b8b641bfbb49e2f3ff863e7d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.7L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '477f3e37-ff75-5318-abdd-0850833645a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TALISMAN',
 'odometer': 199348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477f3e37-ff75-5318-abdd-0850833645a9/477f3e37-ff75-5318-abdd-0850833645a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/809/0f621ca1b8b641bfbb49e2f3ff863e7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT TALISMAN Limited Blue dCi 88 kW (120CV)',
 'transmission': 'manual',
 'trim': 'Limited Blue dCi 88 kW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981495%27 HTTP/1.1" 200 None
2026-03-24 18:34:17 [ayvens.es] INFO: Saving data for 1981495: {'created_time': 1774377257.198733, 'last_price_update_time': 1774377257.198744, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981495') HTTP/1.1" 204 0
2026-03-24 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0ed00139-9aac-5df5-852d-18daddeeaa52 with identifier: 1981496
2026-03-24 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0ed00139-9aac-5df5-852d-18daddeeaa52 with identifier: 1981496
2026-03-24 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0ed00139-9aac-5df5-852d-18daddeeaa52 with identifier: 1981496 to the API
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/139/79d8011d8697489daf3f12a622010bc9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0ed00139-9aac-5df5-852d-18daddeeaa52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 132792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed00139-9aac-5df5-852d-18daddeeaa52/0ed00139-9aac-5df5-852d-18daddeeaa52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/139/79d8011d8697489daf3f12a622010bc9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981496%27 HTTP/1.1" 200 None
2026-03-24 18:34:17 [ayvens.es] INFO: Saving data for 1981496: {'created_time': 1774377257.509846, 'last_price_update_time': 1774377257.509857, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981496') HTTP/1.1" 204 0
2026-03-24 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1981497
2026-03-24 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1981497
2026-03-24 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1981497 to the API
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/110c6af954cc4a31905006faca031d98/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b1794127-7af2-5157-9935-4d62cd87fc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 152124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1794127-7af2-5157-9935-4d62cd87fc27/b1794127-7af2-5157-9935-4d62cd87fc27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/110c6af954cc4a31905006faca031d98/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 81KW (110 CV) Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW (110 CV) Ambition',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981497%27 HTTP/1.1" 200 None
2026-03-24 18:34:17 [ayvens.es] INFO: Saving data for 1981497: {'created_time': 1774377257.781951, 'last_price_update_time': 1774377257.78196, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981497') HTTP/1.1" 204 0
2026-03-24 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/34c908343d244406ad6cd8c60d0d1d91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/882/97b066ad804d4042a3a5ee5eeac1c6e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/400/01b5f9dc950c46468e89b691a2206442/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:17 [ayvens.es] INFO: Found listing with ID: 1981507
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981507%27 HTTP/1.1" 200 None
2026-03-24 18:34:17 [ayvens.es] INFO: Scrape type for 1981507: 1
2026-03-24 18:34:17 [ayvens.es] INFO: Extracting data for car ID: 1981507
2026-03-24 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1981507
2026-03-24 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with scrape type 1
2026-03-24 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F9c67f9b0c34d4ea09e6f84ec2ddcdf0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/9c67f9b0c34d4ea09e6f84ec2ddcdf0c/images/large/1.jpg not downloaded yet
2026-03-24 18:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8713d0>
2026-03-24 18:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c540198b-6a60-5e34-8ef8-e3bfbbc4bf98/c540198b-6a60-5e34-8ef8-e3bfbbc4bf98_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252Fc08d177beb2948daaaebbc12535de825%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/c08d177beb2948daaaebbc12535de825/images/large/1.jpg saved to cache
2026-03-24 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c540198b-6a60-5e34-8ef8-e3bfbbc4bf98
2026-03-24 18:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c540198b-6a60-5e34-8ef8-e3bfbbc4bf98, skipping ID generation
2026-03-24 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c540198b-6a60-5e34-8ef8-e3bfbbc4bf98 with scrape type 1
2026-03-24 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c540198b-6a60-5e34-8ef8-e3bfbbc4bf98 sending to next pipeline
2026-03-24 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c540198b-6a60-5e34-8ef8-e3bfbbc4bf98, identifier: 1981499
2026-03-24 18:34:18 [ayvens.es] INFO: Found listing with ID: 1981508
2026-03-24 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981508%27 HTTP/1.1" 200 None
2026-03-24 18:34:18 [ayvens.es] INFO: Scrape type for 1981508: 1
2026-03-24 18:34:18 [ayvens.es] INFO: Extracting data for car ID: 1981508
2026-03-24 18:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0 with identifier: 1981508
2026-03-24 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0 with scrape type 1
2026-03-24 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0
2026-03-24 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F570%252Fabe752c08e61454aa2e35b75caab8247%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/570/abe752c08e61454aa2e35b75caab8247/images/large/1.jpg not downloaded yet
2026-03-24 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c540198b-6a60-5e34-8ef8-e3bfbbc4bf98 with identifier: 1981499
2026-03-24 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c540198b-6a60-5e34-8ef8-e3bfbbc4bf98 with identifier: 1981499
2026-03-24 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c540198b-6a60-5e34-8ef8-e3bfbbc4bf98 with identifier: 1981499 to the API
2026-03-24 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/103/c08d177beb2948daaaebbc12535de825/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c540198b-6a60-5e34-8ef8-e3bfbbc4bf98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 149913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c540198b-6a60-5e34-8ef8-e3bfbbc4bf98/c540198b-6a60-5e34-8ef8-e3bfbbc4bf98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/103/c08d177beb2948daaaebbc12535de825/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 (O) 2.0 D5 AWD Inscription Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D5 AWD Inscription Auto',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981499%27 HTTP/1.1" 200 None
2026-03-24 18:34:19 [ayvens.es] INFO: Saving data for 1981499: {'created_time': 1774377259.334189, 'last_price_update_time': 1774377259.334199, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981499') HTTP/1.1" 204 0
2026-03-24 18:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/495/1cef2e5de44e4c4cab3fec8cd2cd80e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/560/1871fc96820e4a6c9e6348fb382d5665/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:19 [ayvens.es] INFO: Found listing with ID: 1981509
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981509%27 HTTP/1.1" 200 None
2026-03-24 18:34:19 [ayvens.es] INFO: Scrape type for 1981509: 1
2026-03-24 18:34:19 [ayvens.es] INFO: Extracting data for car ID: 1981509
2026-03-24 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb560499-5209-5c24-b0ad-7f1f6033b01c with identifier: 1981509
2026-03-24 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb560499-5209-5c24-b0ad-7f1f6033b01c with scrape type 1
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb560499-5209-5c24-b0ad-7f1f6033b01c
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F383%252Feda7ffe21b7f485e8509c1626d0017ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/383/eda7ffe21b7f485e8509c1626d0017ee/images/large/1.jpg not downloaded yet
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6c5410>
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b271d-fc2d-5ee1-8855-f910dee21907/ee6b271d-fc2d-5ee1-8855-f910dee21907_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F34c908343d244406ad6cd8c60d0d1d91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/34c908343d244406ad6cd8c60d0d1d91/images/large/1.jpg saved to cache
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee6b271d-fc2d-5ee1-8855-f910dee21907
2026-03-24 18:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee6b271d-fc2d-5ee1-8855-f910dee21907, skipping ID generation
2026-03-24 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6b271d-fc2d-5ee1-8855-f910dee21907 with scrape type 1
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee6b271d-fc2d-5ee1-8855-f910dee21907 sending to next pipeline
2026-03-24 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee6b271d-fc2d-5ee1-8855-f910dee21907, identifier: 1981498
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9f8750>
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb1d0e8-3c37-54e2-a931-b7a41b43732b/3fb1d0e8-3c37-54e2-a931-b7a41b43732b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F882%252F97b066ad804d4042a3a5ee5eeac1c6e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/882/97b066ad804d4042a3a5ee5eeac1c6e4/images/large/1.jpg saved to cache
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fb1d0e8-3c37-54e2-a931-b7a41b43732b
2026-03-24 18:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fb1d0e8-3c37-54e2-a931-b7a41b43732b, skipping ID generation
2026-03-24 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fb1d0e8-3c37-54e2-a931-b7a41b43732b with scrape type 1
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fb1d0e8-3c37-54e2-a931-b7a41b43732b sending to next pipeline
2026-03-24 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3fb1d0e8-3c37-54e2-a931-b7a41b43732b, identifier: 1981500
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7eb490>
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d25fb5f3-f2ff-5a01-97c9-c89a74370780/d25fb5f3-f2ff-5a01-97c9-c89a74370780_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252F01b5f9dc950c46468e89b691a2206442%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/01b5f9dc950c46468e89b691a2206442/images/large/1.jpg saved to cache
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d25fb5f3-f2ff-5a01-97c9-c89a74370780
2026-03-24 18:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d25fb5f3-f2ff-5a01-97c9-c89a74370780, skipping ID generation
2026-03-24 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d25fb5f3-f2ff-5a01-97c9-c89a74370780 with scrape type 1
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d25fb5f3-f2ff-5a01-97c9-c89a74370780 sending to next pipeline
2026-03-24 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d25fb5f3-f2ff-5a01-97c9-c89a74370780, identifier: 1981501
2026-03-24 18:34:19 [ayvens.es] INFO: Found listing with ID: 1981510
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981510%27 HTTP/1.1" 200 None
2026-03-24 18:34:19 [ayvens.es] INFO: Scrape type for 1981510: 1
2026-03-24 18:34:19 [ayvens.es] INFO: Extracting data for car ID: 1981510
2026-03-24 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1eb678-2035-5d87-a7d6-56e9b08e0435 with identifier: 1981510
2026-03-24 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1eb678-2035-5d87-a7d6-56e9b08e0435 with scrape type 1
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ae1eb678-2035-5d87-a7d6-56e9b08e0435
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F349%252Fcd524de0085042949a64b34624f13282%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/349/cd524de0085042949a64b34624f13282/images/large/1.jpg not downloaded yet
2026-03-24 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1981498
2026-03-24 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1981498
2026-03-24 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1981498 to the API
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/34c908343d244406ad6cd8c60d0d1d91/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee6b271d-fc2d-5ee1-8855-f910dee21907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 182742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b271d-fc2d-5ee1-8855-f910dee21907/ee6b271d-fc2d-5ee1-8855-f910dee21907_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/34c908343d244406ad6cd8c60d0d1d91/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981498%27 HTTP/1.1" 200 None
2026-03-24 18:34:20 [ayvens.es] INFO: Saving data for 1981498: {'created_time': 1774377260.220592, 'last_price_update_time': 1774377260.220604, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981498') HTTP/1.1" 204 0
2026-03-24 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3fb1d0e8-3c37-54e2-a931-b7a41b43732b with identifier: 1981500
2026-03-24 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3fb1d0e8-3c37-54e2-a931-b7a41b43732b with identifier: 1981500
2026-03-24 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3fb1d0e8-3c37-54e2-a931-b7a41b43732b with identifier: 1981500 to the API
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/882/97b066ad804d4042a3a5ee5eeac1c6e4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3fb1d0e8-3c37-54e2-a931-b7a41b43732b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 167482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb1d0e8-3c37-54e2-a931-b7a41b43732b/3fb1d0e8-3c37-54e2-a931-b7a41b43732b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/882/97b066ad804d4042a3a5ee5eeac1c6e4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 Momentum Core',
 'transmission': 'manual',
 'trim': '1.5 T2 Momentum Core',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981500%27 HTTP/1.1" 200 None
2026-03-24 18:34:20 [ayvens.es] INFO: Saving data for 1981500: {'created_time': 1774377260.797943, 'last_price_update_time': 1774377260.797954, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981500') HTTP/1.1" 204 0
2026-03-24 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d25fb5f3-f2ff-5a01-97c9-c89a74370780 with identifier: 1981501
2026-03-24 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d25fb5f3-f2ff-5a01-97c9-c89a74370780 with identifier: 1981501
2026-03-24 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d25fb5f3-f2ff-5a01-97c9-c89a74370780 with identifier: 1981501 to the API
2026-03-24 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/400/01b5f9dc950c46468e89b691a2206442/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco luna metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd25fb5f3-f2ff-5a01-97c9-c89a74370780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 108572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d25fb5f3-f2ff-5a01-97c9-c89a74370780/d25fb5f3-f2ff-5a01-97c9-c89a74370780_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/400/01b5f9dc950c46468e89b691a2206442/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 85kW (115CV) DSG Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) DSG Ambition',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981501%27 HTTP/1.1" 200 None
2026-03-24 18:34:21 [ayvens.es] INFO: Saving data for 1981501: {'created_time': 1774377261.135137, 'last_price_update_time': 1774377261.135147, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981501') HTTP/1.1" 204 0
2026-03-24 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/468/6fe1c2d63df441cf8b1421763088af6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:21 [ayvens.es] INFO: Found listing with ID: 1981511
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981511%27 HTTP/1.1" 200 None
2026-03-24 18:34:21 [ayvens.es] INFO: Scrape type for 1981511: 1
2026-03-24 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1981511
2026-03-24 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42e6455-62dd-5ce0-b3cf-f6b076e997fc with identifier: 1981511
2026-03-24 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42e6455-62dd-5ce0-b3cf-f6b076e997fc with scrape type 1
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c42e6455-62dd-5ce0-b3cf-f6b076e997fc
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F84bd8291c620475d808de08e49a14c32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/84bd8291c620475d808de08e49a14c32/images/large/1.jpg not downloaded yet
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0fd410>
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0395a7f-39d5-5dc6-8866-75cca68c500a/f0395a7f-39d5-5dc6-8866-75cca68c500a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252F1cef2e5de44e4c4cab3fec8cd2cd80e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/1cef2e5de44e4c4cab3fec8cd2cd80e5/images/large/1.jpg saved to cache
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0395a7f-39d5-5dc6-8866-75cca68c500a
2026-03-24 18:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0395a7f-39d5-5dc6-8866-75cca68c500a, skipping ID generation
2026-03-24 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0395a7f-39d5-5dc6-8866-75cca68c500a with scrape type 1
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0395a7f-39d5-5dc6-8866-75cca68c500a sending to next pipeline
2026-03-24 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f0395a7f-39d5-5dc6-8866-75cca68c500a, identifier: 1981502
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea08c50>
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5636adce-2449-531a-b464-5aded1c14884/5636adce-2449-531a-b464-5aded1c14884_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F560%252F1871fc96820e4a6c9e6348fb382d5665%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/560/1871fc96820e4a6c9e6348fb382d5665/images/large/1.jpg saved to cache
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5636adce-2449-531a-b464-5aded1c14884
2026-03-24 18:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5636adce-2449-531a-b464-5aded1c14884, skipping ID generation
2026-03-24 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5636adce-2449-531a-b464-5aded1c14884 with scrape type 1
2026-03-24 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5636adce-2449-531a-b464-5aded1c14884 sending to next pipeline
2026-03-24 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5636adce-2449-531a-b464-5aded1c14884, identifier: 1981503
2026-03-24 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f0395a7f-39d5-5dc6-8866-75cca68c500a with identifier: 1981502
2026-03-24 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f0395a7f-39d5-5dc6-8866-75cca68c500a with identifier: 1981502
2026-03-24 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f0395a7f-39d5-5dc6-8866-75cca68c500a with identifier: 1981502 to the API
2026-03-24 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/495/1cef2e5de44e4c4cab3fec8cd2cd80e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f0395a7f-39d5-5dc6-8866-75cca68c500a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 195653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0395a7f-39d5-5dc6-8866-75cca68c500a/f0395a7f-39d5-5dc6-8866-75cca68c500a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/495/1cef2e5de44e4c4cab3fec8cd2cd80e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981502%27 HTTP/1.1" 200 None
2026-03-24 18:34:22 [ayvens.es] INFO: Saving data for 1981502: {'created_time': 1774377262.483161, 'last_price_update_time': 1774377262.483171, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981502') HTTP/1.1" 204 0
2026-03-24 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1981503
2026-03-24 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1981503
2026-03-24 18:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1981503 to the API
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/560/1871fc96820e4a6c9e6348fb382d5665/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5636adce-2449-531a-b464-5aded1c14884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 118468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5636adce-2449-531a-b464-5aded1c14884/5636adce-2449-531a-b464-5aded1c14884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/560/1871fc96820e4a6c9e6348fb382d5665/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981503%27 HTTP/1.1" 200 None
2026-03-24 18:34:22 [ayvens.es] INFO: Saving data for 1981503: {'created_time': 1774377262.788724, 'last_price_update_time': 1774377262.788734, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981503') HTTP/1.1" 204 0
2026-03-24 18:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/911/7084fc8297824ea9bef097d447e45af8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:22 [ayvens.es] INFO: Found listing with ID: 1981512
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981512%27 HTTP/1.1" 200 None
2026-03-24 18:34:22 [ayvens.es] INFO: Scrape type for 1981512: 1
2026-03-24 18:34:22 [ayvens.es] INFO: Extracting data for car ID: 1981512
2026-03-24 18:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d25eef97-9068-5406-a605-da5e7b5afb34 with identifier: 1981512
2026-03-24 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d25eef97-9068-5406-a605-da5e7b5afb34 with scrape type 1
2026-03-24 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d25eef97-9068-5406-a605-da5e7b5afb34
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F777%252F1b20c5ee42254739a2dd8aaaaaa4d42c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/777/1b20c5ee42254739a2dd8aaaaaa4d42c/images/large/1.jpg not downloaded yet
2026-03-24 18:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/052/0898393ce63446c8895f7c9679dfab01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7b9ad0>
2026-03-24 18:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d09e721-a595-5d2e-967a-89a270e45bd6/8d09e721-a595-5d2e-967a-89a270e45bd6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F6fe1c2d63df441cf8b1421763088af6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/6fe1c2d63df441cf8b1421763088af6d/images/large/1.jpg saved to cache
2026-03-24 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d09e721-a595-5d2e-967a-89a270e45bd6
2026-03-24 18:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d09e721-a595-5d2e-967a-89a270e45bd6, skipping ID generation
2026-03-24 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d09e721-a595-5d2e-967a-89a270e45bd6 with scrape type 1
2026-03-24 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d09e721-a595-5d2e-967a-89a270e45bd6 sending to next pipeline
2026-03-24 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8d09e721-a595-5d2e-967a-89a270e45bd6, identifier: 1981504
2026-03-24 18:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/638/9c67f9b0c34d4ea09e6f84ec2ddcdf0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:23 [ayvens.es] INFO: Found listing with ID: 1981513
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981513%27 HTTP/1.1" 200 None
2026-03-24 18:34:23 [ayvens.es] INFO: Scrape type for 1981513: 1
2026-03-24 18:34:23 [ayvens.es] INFO: Extracting data for car ID: 1981513
2026-03-24 18:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8657edf-1875-5007-a3c3-7ac1fa55cdfd with identifier: 1981513
2026-03-24 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8657edf-1875-5007-a3c3-7ac1fa55cdfd with scrape type 1
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8657edf-1875-5007-a3c3-7ac1fa55cdfd
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F660%252Ffc755a33ecd94b71840ee0368442072e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/660/fc755a33ecd94b71840ee0368442072e/images/large/1.jpg not downloaded yet
2026-03-24 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1981504
2026-03-24 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1981504
2026-03-24 18:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1981504 to the API
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/468/6fe1c2d63df441cf8b1421763088af6d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d09e721-a595-5d2e-967a-89a270e45bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 139045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d09e721-a595-5d2e-967a-89a270e45bd6/8d09e721-a595-5d2e-967a-89a270e45bd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/468/6fe1c2d63df441cf8b1421763088af6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981504%27 HTTP/1.1" 200 None
2026-03-24 18:34:23 [ayvens.es] INFO: Saving data for 1981504: {'created_time': 1774377263.330958, 'last_price_update_time': 1774377263.330971, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981504') HTTP/1.1" 204 0
2026-03-24 18:34:23 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-24 18:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/570/abe752c08e61454aa2e35b75caab8247/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7cc610>
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77c56427-74e0-594a-94cf-9905e7323d28/77c56427-74e0-594a-94cf-9905e7323d28_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252F7084fc8297824ea9bef097d447e45af8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/7084fc8297824ea9bef097d447e45af8/images/large/1.jpg saved to cache
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77c56427-74e0-594a-94cf-9905e7323d28
2026-03-24 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77c56427-74e0-594a-94cf-9905e7323d28, skipping ID generation
2026-03-24 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c56427-74e0-594a-94cf-9905e7323d28 with scrape type 1
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77c56427-74e0-594a-94cf-9905e7323d28 sending to next pipeline
2026-03-24 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77c56427-74e0-594a-94cf-9905e7323d28, identifier: 1981505
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1fef90>
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121f2e30-8059-5aac-a0e7-a20fcbeaf690/121f2e30-8059-5aac-a0e7-a20fcbeaf690_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F052%252F0898393ce63446c8895f7c9679dfab01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/052/0898393ce63446c8895f7c9679dfab01/images/large/1.jpg saved to cache
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690
2026-03-24 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 121f2e30-8059-5aac-a0e7-a20fcbeaf690, skipping ID generation
2026-03-24 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with scrape type 1
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690 sending to next pipeline
2026-03-24 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 121f2e30-8059-5aac-a0e7-a20fcbeaf690, identifier: 1981506
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05fae50>
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a79e8c-942e-5c44-8889-fa1db6fd3d9f/b9a79e8c-942e-5c44-8889-fa1db6fd3d9f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F9c67f9b0c34d4ea09e6f84ec2ddcdf0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/9c67f9b0c34d4ea09e6f84ec2ddcdf0c/images/large/1.jpg saved to cache
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f
2026-03-24 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f, skipping ID generation
2026-03-24 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with scrape type 1
2026-03-24 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f sending to next pipeline
2026-03-24 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f, identifier: 1981507
2026-03-24 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1981505
2026-03-24 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1981505
2026-03-24 18:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1981505 to the API
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/911/7084fc8297824ea9bef097d447e45af8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '77c56427-74e0-594a-94cf-9905e7323d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 50104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77c56427-74e0-594a-94cf-9905e7323d28/77c56427-74e0-594a-94cf-9905e7323d28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/911/7084fc8297824ea9bef097d447e45af8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Emotion',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981505%27 HTTP/1.1" 200 None
2026-03-24 18:34:24 [ayvens.es] INFO: Saving data for 1981505: {'created_time': 1774377264.034948, 'last_price_update_time': 1774377264.034958, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981505') HTTP/1.1" 204 0
2026-03-24 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1981506
2026-03-24 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1981506
2026-03-24 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1981506 to the API
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/052/0898393ce63446c8895f7c9679dfab01/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '121f2e30-8059-5aac-a0e7-a20fcbeaf690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'YETI',
 'odometer': 233816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121f2e30-8059-5aac-a0e7-a20fcbeaf690/121f2e30-8059-5aac-a0e7-a20fcbeaf690_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/052/0898393ce63446c8895f7c9679dfab01/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA YETI 2.0 TDI 110cv 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110cv 4x4 Ambition',
 'vin': None,
 'year': 2013}
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981506%27 HTTP/1.1" 200 None
2026-03-24 18:34:24 [ayvens.es] INFO: Saving data for 1981506: {'created_time': 1774377264.319828, 'last_price_update_time': 1774377264.319838, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981506') HTTP/1.1" 204 0
2026-03-24 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1981507
2026-03-24 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1981507
2026-03-24 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1981507 to the API
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/638/9c67f9b0c34d4ea09e6f84ec2ddcdf0c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b9a79e8c-942e-5c44-8889-fa1db6fd3d9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 128644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a79e8c-942e-5c44-8889-fa1db6fd3d9f/b9a79e8c-942e-5c44-8889-fa1db6fd3d9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/638/9c67f9b0c34d4ea09e6f84ec2ddcdf0c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981507%27 HTTP/1.1" 200 None
2026-03-24 18:34:24 [ayvens.es] INFO: Saving data for 1981507: {'created_time': 1774377264.618836, 'last_price_update_time': 1774377264.618848, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981507') HTTP/1.1" 204 0
2026-03-24 18:34:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/383/eda7ffe21b7f485e8509c1626d0017ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/349/cd524de0085042949a64b34624f13282/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/558/84bd8291c620475d808de08e49a14c32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb70e50>
2026-03-24 18:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ecc6dc6-c733-5cb7-8255-bd57f0b729a0/7ecc6dc6-c733-5cb7-8255-bd57f0b729a0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F570%252Fabe752c08e61454aa2e35b75caab8247%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/570/abe752c08e61454aa2e35b75caab8247/images/large/1.jpg saved to cache
2026-03-24 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0
2026-03-24 18:34:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0, skipping ID generation
2026-03-24 18:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0 with scrape type 1
2026-03-24 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0 sending to next pipeline
2026-03-24 18:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0, identifier: 1981508
2026-03-24 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0 with identifier: 1981508
2026-03-24 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0 with identifier: 1981508
2026-03-24 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7ecc6dc6-c733-5cb7-8255-bd57f0b729a0 with identifier: 1981508 to the API
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/570/abe752c08e61454aa2e35b75caab8247/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ecc6dc6-c733-5cb7-8255-bd57f0b729a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 123121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecc6dc6-c733-5cb7-8255-bd57f0b729a0/7ecc6dc6-c733-5cb7-8255-bd57f0b729a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/570/abe752c08e61454aa2e35b75caab8247/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981508%27 HTTP/1.1" 200 None
2026-03-24 18:34:25 [ayvens.es] INFO: Saving data for 1981508: {'created_time': 1774377265.078315, 'last_price_update_time': 1774377265.078325, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981508') HTTP/1.1" 204 0
2026-03-24 18:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/777/1b20c5ee42254739a2dd8aaaaaa4d42c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f8790>
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb560499-5209-5c24-b0ad-7f1f6033b01c/fb560499-5209-5c24-b0ad-7f1f6033b01c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F383%252Feda7ffe21b7f485e8509c1626d0017ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/383/eda7ffe21b7f485e8509c1626d0017ee/images/large/1.jpg saved to cache
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb560499-5209-5c24-b0ad-7f1f6033b01c
2026-03-24 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb560499-5209-5c24-b0ad-7f1f6033b01c, skipping ID generation
2026-03-24 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb560499-5209-5c24-b0ad-7f1f6033b01c with scrape type 1
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb560499-5209-5c24-b0ad-7f1f6033b01c sending to next pipeline
2026-03-24 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fb560499-5209-5c24-b0ad-7f1f6033b01c, identifier: 1981509
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8d18d0>
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1eb678-2035-5d87-a7d6-56e9b08e0435/ae1eb678-2035-5d87-a7d6-56e9b08e0435_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F349%252Fcd524de0085042949a64b34624f13282%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/349/cd524de0085042949a64b34624f13282/images/large/1.jpg saved to cache
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae1eb678-2035-5d87-a7d6-56e9b08e0435
2026-03-24 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae1eb678-2035-5d87-a7d6-56e9b08e0435, skipping ID generation
2026-03-24 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1eb678-2035-5d87-a7d6-56e9b08e0435 with scrape type 1
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae1eb678-2035-5d87-a7d6-56e9b08e0435 sending to next pipeline
2026-03-24 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ae1eb678-2035-5d87-a7d6-56e9b08e0435, identifier: 1981510
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7cd510>
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42e6455-62dd-5ce0-b3cf-f6b076e997fc/c42e6455-62dd-5ce0-b3cf-f6b076e997fc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F84bd8291c620475d808de08e49a14c32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/84bd8291c620475d808de08e49a14c32/images/large/1.jpg saved to cache
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c42e6455-62dd-5ce0-b3cf-f6b076e997fc
2026-03-24 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c42e6455-62dd-5ce0-b3cf-f6b076e997fc, skipping ID generation
2026-03-24 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42e6455-62dd-5ce0-b3cf-f6b076e997fc with scrape type 1
2026-03-24 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c42e6455-62dd-5ce0-b3cf-f6b076e997fc sending to next pipeline
2026-03-24 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c42e6455-62dd-5ce0-b3cf-f6b076e997fc, identifier: 1981511
2026-03-24 18:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/660/fc755a33ecd94b71840ee0368442072e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fb560499-5209-5c24-b0ad-7f1f6033b01c with identifier: 1981509
2026-03-24 18:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fb560499-5209-5c24-b0ad-7f1f6033b01c with identifier: 1981509
2026-03-24 18:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fb560499-5209-5c24-b0ad-7f1f6033b01c with identifier: 1981509 to the API
2026-03-24 18:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/383/eda7ffe21b7f485e8509c1626d0017ee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fb560499-5209-5c24-b0ad-7f1f6033b01c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 12389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb560499-5209-5c24-b0ad-7f1f6033b01c/fb560499-5209-5c24-b0ad-7f1f6033b01c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/383/eda7ffe21b7f485e8509c1626d0017ee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE E-CVT',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981509%27 HTTP/1.1" 200 None
2026-03-24 18:34:26 [ayvens.es] INFO: Saving data for 1981509: {'created_time': 1774377266.478741, 'last_price_update_time': 1774377266.478752, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981509') HTTP/1.1" 204 0
2026-03-24 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ae1eb678-2035-5d87-a7d6-56e9b08e0435 with identifier: 1981510
2026-03-24 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ae1eb678-2035-5d87-a7d6-56e9b08e0435 with identifier: 1981510
2026-03-24 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ae1eb678-2035-5d87-a7d6-56e9b08e0435 with identifier: 1981510 to the API
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/349/cd524de0085042949a64b34624f13282/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ae1eb678-2035-5d87-a7d6-56e9b08e0435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 125300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1eb678-2035-5d87-a7d6-56e9b08e0435/ae1eb678-2035-5d87-a7d6-56e9b08e0435_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/349/cd524de0085042949a64b34624f13282/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981510%27 HTTP/1.1" 200 None
2026-03-24 18:34:26 [ayvens.es] INFO: Saving data for 1981510: {'created_time': 1774377266.768936, 'last_price_update_time': 1774377266.768946, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981510') HTTP/1.1" 204 0
2026-03-24 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c42e6455-62dd-5ce0-b3cf-f6b076e997fc with identifier: 1981511
2026-03-24 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c42e6455-62dd-5ce0-b3cf-f6b076e997fc with identifier: 1981511
2026-03-24 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c42e6455-62dd-5ce0-b3cf-f6b076e997fc with identifier: 1981511 to the API
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/558/84bd8291c620475d808de08e49a14c32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris ceres',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c42e6455-62dd-5ce0-b3cf-f6b076e997fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 282947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42e6455-62dd-5ce0-b3cf-f6b076e997fc/c42e6455-62dd-5ce0-b3cf-f6b076e997fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/558/84bd8291c620475d808de08e49a14c32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON Elegance 2.0 TDI 110kW (150CV) DSG SB',
 'transmission': 'manual',
 'trim': 'Elegance 2.0 TDI 110kW (150CV) DSG SB',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981511%27 HTTP/1.1" 200 None
2026-03-24 18:34:27 [ayvens.es] INFO: Saving data for 1981511: {'created_time': 1774377267.051802, 'last_price_update_time': 1774377267.051811, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981511') HTTP/1.1" 204 0
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee92fe10>
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d25eef97-9068-5406-a605-da5e7b5afb34/d25eef97-9068-5406-a605-da5e7b5afb34_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F777%252F1b20c5ee42254739a2dd8aaaaaa4d42c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/777/1b20c5ee42254739a2dd8aaaaaa4d42c/images/large/1.jpg saved to cache
2026-03-24 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d25eef97-9068-5406-a605-da5e7b5afb34
2026-03-24 18:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d25eef97-9068-5406-a605-da5e7b5afb34, skipping ID generation
2026-03-24 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d25eef97-9068-5406-a605-da5e7b5afb34 with scrape type 1
2026-03-24 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d25eef97-9068-5406-a605-da5e7b5afb34 sending to next pipeline
2026-03-24 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d25eef97-9068-5406-a605-da5e7b5afb34, identifier: 1981512
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7ccd10>
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8657edf-1875-5007-a3c3-7ac1fa55cdfd/d8657edf-1875-5007-a3c3-7ac1fa55cdfd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F660%252Ffc755a33ecd94b71840ee0368442072e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/660/fc755a33ecd94b71840ee0368442072e/images/large/1.jpg saved to cache
2026-03-24 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8657edf-1875-5007-a3c3-7ac1fa55cdfd
2026-03-24 18:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8657edf-1875-5007-a3c3-7ac1fa55cdfd, skipping ID generation
2026-03-24 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8657edf-1875-5007-a3c3-7ac1fa55cdfd with scrape type 1
2026-03-24 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8657edf-1875-5007-a3c3-7ac1fa55cdfd sending to next pipeline
2026-03-24 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d8657edf-1875-5007-a3c3-7ac1fa55cdfd, identifier: 1981513
2026-03-24 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d25eef97-9068-5406-a605-da5e7b5afb34 with identifier: 1981512
2026-03-24 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d25eef97-9068-5406-a605-da5e7b5afb34 with identifier: 1981512
2026-03-24 18:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d25eef97-9068-5406-a605-da5e7b5afb34 with identifier: 1981512 to the API
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/777/1b20c5ee42254739a2dd8aaaaaa4d42c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd25eef97-9068-5406-a605-da5e7b5afb34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 232432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d25eef97-9068-5406-a605-da5e7b5afb34/d25eef97-9068-5406-a605-da5e7b5afb34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/777/1b20c5ee42254739a2dd8aaaaaa4d42c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981512%27 HTTP/1.1" 200 None
2026-03-24 18:34:27 [ayvens.es] INFO: Saving data for 1981512: {'created_time': 1774377267.635733, 'last_price_update_time': 1774377267.635744, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981512') HTTP/1.1" 204 0
2026-03-24 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d8657edf-1875-5007-a3c3-7ac1fa55cdfd with identifier: 1981513
2026-03-24 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d8657edf-1875-5007-a3c3-7ac1fa55cdfd with identifier: 1981513
2026-03-24 18:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d8657edf-1875-5007-a3c3-7ac1fa55cdfd with identifier: 1981513 to the API
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/660/fc755a33ecd94b71840ee0368442072e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Plata refl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd8657edf-1875-5007-a3c3-7ac1fa55cdfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 148023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8657edf-1875-5007-a3c3-7ac1fa55cdfd/d8657edf-1875-5007-a3c3-7ac1fa55cdfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/660/fc755a33ecd94b71840ee0368442072e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS Advance 1.0 TSI 81kW (110CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 81kW (110CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981513%27 HTTP/1.1" 200 None
2026-03-24 18:34:27 [ayvens.es] INFO: Saving data for 1981513: {'created_time': 1774377267.912037, 'last_price_update_time': 1774377267.912049, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981513') HTTP/1.1" 204 0
2026-03-24 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981514
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981514%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981514: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981514
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c with identifier: 1981514
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F183%252F143b752903f34a59bc63244570c12f32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/183/143b752903f34a59bc63244570c12f32/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981515
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981515%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981515: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981515
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80 with identifier: 1981515
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F332%252F87d4bdddfa7b407196b1d998ecd3ef84%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/332/87d4bdddfa7b407196b1d998ecd3ef84/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981516
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981516%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981516: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981516
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660c5c7a-103e-5f7b-a590-974ac1782661 with identifier: 1981516
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660c5c7a-103e-5f7b-a590-974ac1782661 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 660c5c7a-103e-5f7b-a590-974ac1782661
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F639%252F4991f16e071a4a60a3a2f5a11d95e7ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/639/4991f16e071a4a60a3a2f5a11d95e7ab/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981517
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981517%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981517: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981517
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1981517
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F02ed061d4fef4ea6996f1a8d15e70e52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/02ed061d4fef4ea6996f1a8d15e70e52/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981518
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981518%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981518: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981518
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70dfd836-86a8-5189-9bf7-6d09c20f4ef5 with identifier: 1981518
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70dfd836-86a8-5189-9bf7-6d09c20f4ef5 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70dfd836-86a8-5189-9bf7-6d09c20f4ef5
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252Fe72c581ba0ce4f72ab5bbd41a010dc7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/e72c581ba0ce4f72ab5bbd41a010dc7b/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981519
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981519%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981519: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981519
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f7710b-f590-5ee1-bec7-55a102b9067c with identifier: 1981519
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f7710b-f590-5ee1-bec7-55a102b9067c with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45f7710b-f590-5ee1-bec7-55a102b9067c
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F5ac4a78df54b4460bf35b35f22d87d54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/5ac4a78df54b4460bf35b35f22d87d54/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981520
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981520%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981520: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981520
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46 with identifier: 1981520
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F287%252Ff9ae44389bf1415b93a5d36c64f6379f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/287/f9ae44389bf1415b93a5d36c64f6379f/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981521
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981521%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981521: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981521
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e547614-e1c5-5271-b8e4-325cd575ffb3 with identifier: 1981521
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e547614-e1c5-5271-b8e4-325cd575ffb3 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e547614-e1c5-5271-b8e4-325cd575ffb3
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F916%252F2afcd86725df47cba86c847f2dad0cf6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/916/2afcd86725df47cba86c847f2dad0cf6/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981522
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981522%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981522: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981522
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1981522
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c580f71-6565-54e3-ad78-7822755cd3da with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9c580f71-6565-54e3-ad78-7822755cd3da
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252F5d0d4c56b4cc42ba8919de1a98e7d713%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/5d0d4c56b4cc42ba8919de1a98e7d713/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981523
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981523%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981523: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981523
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1981523
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F152%252F5b9e34d0d4524c4592cb00c4df283091%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/152/5b9e34d0d4524c4592cb00c4df283091/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/183/143b752903f34a59bc63244570c12f32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/332/87d4bdddfa7b407196b1d998ecd3ef84/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981524
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981524%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981524: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981524
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1981524
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F939%252Ffd17cd88bf4c4bb3900ca9441130095e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/939/fd17cd88bf4c4bb3900ca9441130095e/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/639/4991f16e071a4a60a3a2f5a11d95e7ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981525
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981525%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981525: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981525
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 716fcb1c-ec4e-5f96-a1d6-440e56bef133 with identifier: 1981525
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 716fcb1c-ec4e-5f96-a1d6-440e56bef133 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 716fcb1c-ec4e-5f96-a1d6-440e56bef133
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F750%252F37be145e4b384aa999d8efe74d71bf87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/750/37be145e4b384aa999d8efe74d71bf87/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981526
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981526%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981526: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981526
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1981526
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1017ee0b-a992-5018-a328-9926375a70b3 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1017ee0b-a992-5018-a328-9926375a70b3
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252Ff3e270b5e1794bb4943cc157e1f97934%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/f3e270b5e1794bb4943cc157e1f97934/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981527
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981527%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981527: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981527
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 763093c1-5d8f-503c-b86a-bf80bcb1764b with identifier: 1981527
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 763093c1-5d8f-503c-b86a-bf80bcb1764b with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 763093c1-5d8f-503c-b86a-bf80bcb1764b
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F656%252Ff473a0f9c94f4cc49a422efb87714266%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/656/f473a0f9c94f4cc49a422efb87714266/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/5ac4a78df54b4460bf35b35f22d87d54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:29 [ayvens.es] INFO: Found listing with ID: 1981528
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981528%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [ayvens.es] INFO: Scrape type for 1981528: 1
2026-03-24 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1981528
2026-03-24 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64b6c8ef-d306-5710-9b69-a80d8c392cd9 with identifier: 1981528
2026-03-24 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b6c8ef-d306-5710-9b69-a80d8c392cd9 with scrape type 1
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64b6c8ef-d306-5710-9b69-a80d8c392cd9
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252Fb2032fae02bb4bbd986712f4126da28e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/b2032fae02bb4bbd986712f4126da28e/images/large/1.jpg not downloaded yet
2026-03-24 18:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee822ed0>
2026-03-24 18:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b394d5a-0f5a-52b4-8866-3c50e4a91d6c/5b394d5a-0f5a-52b4-8866-3c50e4a91d6c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F183%252F143b752903f34a59bc63244570c12f32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/183/143b752903f34a59bc63244570c12f32/images/large/1.jpg saved to cache
2026-03-24 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c
2026-03-24 18:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c, skipping ID generation
2026-03-24 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c with scrape type 1
2026-03-24 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c sending to next pipeline
2026-03-24 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c, identifier: 1981514
2026-03-24 18:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0600290>
2026-03-24 18:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80/a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F332%252F87d4bdddfa7b407196b1d998ecd3ef84%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/332/87d4bdddfa7b407196b1d998ecd3ef84/images/large/1.jpg saved to cache
2026-03-24 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80
2026-03-24 18:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80, skipping ID generation
2026-03-24 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80 with scrape type 1
2026-03-24 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80 sending to next pipeline
2026-03-24 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80, identifier: 1981515
2026-03-24 18:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/511/02ed061d4fef4ea6996f1a8d15e70e52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c with identifier: 1981514
2026-03-24 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c with identifier: 1981514
2026-03-24 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5b394d5a-0f5a-52b4-8866-3c50e4a91d6c with identifier: 1981514 to the API
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/183/143b752903f34a59bc63244570c12f32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5b394d5a-0f5a-52b4-8866-3c50e4a91d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 147453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b394d5a-0f5a-52b4-8866-3c50e4a91d6c/5b394d5a-0f5a-52b4-8866-3c50e4a91d6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/183/143b752903f34a59bc63244570c12f32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Advance 1.6 TDI 59kW (80CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.6 TDI 59kW (80CV)',
 'vin': None,
 'year': 2018}
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981514%27 HTTP/1.1" 200 None
2026-03-24 18:34:30 [ayvens.es] INFO: Saving data for 1981514: {'created_time': 1774377270.627877, 'last_price_update_time': 1774377270.627887, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981514') HTTP/1.1" 204 0
2026-03-24 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80 with identifier: 1981515
2026-03-24 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80 with identifier: 1981515
2026-03-24 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80 with identifier: 1981515 to the API
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/332/87d4bdddfa7b407196b1d998ecd3ef84/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Negro magico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 71396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80/a6094bf3-8dd5-54f0-8fe5-eea5e4aaef80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/332/87d4bdddfa7b407196b1d998ecd3ef84/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 85kW (115CV) Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) Ambition',
 'vin': None,
 'year': 2023}
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981515%27 HTTP/1.1" 200 None
2026-03-24 18:34:30 [ayvens.es] INFO: Saving data for 1981515: {'created_time': 1774377270.983911, 'last_price_update_time': 1774377270.983921, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981515') HTTP/1.1" 204 0
2026-03-24 18:34:31 [ayvens.es] INFO: Found listing with ID: 1981529
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981529%27 HTTP/1.1" 200 None
2026-03-24 18:34:31 [ayvens.es] INFO: Scrape type for 1981529: 1
2026-03-24 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1981529
2026-03-24 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1981529
2026-03-24 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with scrape type 1
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F90081b1c2fbd4d28bd0d4f2eef2652cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/90081b1c2fbd4d28bd0d4f2eef2652cc/images/large/1.jpg not downloaded yet
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05ecbd0>
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_660c5c7a-103e-5f7b-a590-974ac1782661/660c5c7a-103e-5f7b-a590-974ac1782661_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F639%252F4991f16e071a4a60a3a2f5a11d95e7ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/639/4991f16e071a4a60a3a2f5a11d95e7ab/images/large/1.jpg saved to cache
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 660c5c7a-103e-5f7b-a590-974ac1782661
2026-03-24 18:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 660c5c7a-103e-5f7b-a590-974ac1782661, skipping ID generation
2026-03-24 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660c5c7a-103e-5f7b-a590-974ac1782661 with scrape type 1
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 660c5c7a-103e-5f7b-a590-974ac1782661 sending to next pipeline
2026-03-24 18:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 660c5c7a-103e-5f7b-a590-974ac1782661, identifier: 1981516
2026-03-24 18:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 660c5c7a-103e-5f7b-a590-974ac1782661 with identifier: 1981516
2026-03-24 18:34:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 660c5c7a-103e-5f7b-a590-974ac1782661 with identifier: 1981516
2026-03-24 18:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 660c5c7a-103e-5f7b-a590-974ac1782661 with identifier: 1981516 to the API
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/639/4991f16e071a4a60a3a2f5a11d95e7ab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris platinum metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '660c5c7a-103e-5f7b-a590-974ac1782661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 137626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660c5c7a-103e-5f7b-a590-974ac1782661/660c5c7a-103e-5f7b-a590-974ac1782661_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/639/4991f16e071a4a60a3a2f5a11d95e7ab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style BlueHDi 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Style BlueHDi 130 S&S',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981516%27 HTTP/1.1" 200 None
2026-03-24 18:34:31 [ayvens.es] INFO: Saving data for 1981516: {'created_time': 1774377271.700869, 'last_price_update_time': 1774377271.700878, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981516') HTTP/1.1" 204 0
2026-03-24 18:34:31 [ayvens.es] INFO: Found listing with ID: 1981530
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981530%27 HTTP/1.1" 200 None
2026-03-24 18:34:31 [ayvens.es] INFO: Scrape type for 1981530: 1
2026-03-24 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1981530
2026-03-24 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1981530
2026-03-24 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with scrape type 1
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F9781839b70cd40f6a5b8f15653da06bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/9781839b70cd40f6a5b8f15653da06bb/images/large/1.jpg not downloaded yet
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6ba510>
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f7710b-f590-5ee1-bec7-55a102b9067c/45f7710b-f590-5ee1-bec7-55a102b9067c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F5ac4a78df54b4460bf35b35f22d87d54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/5ac4a78df54b4460bf35b35f22d87d54/images/large/1.jpg saved to cache
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45f7710b-f590-5ee1-bec7-55a102b9067c
2026-03-24 18:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45f7710b-f590-5ee1-bec7-55a102b9067c, skipping ID generation
2026-03-24 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f7710b-f590-5ee1-bec7-55a102b9067c with scrape type 1
2026-03-24 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45f7710b-f590-5ee1-bec7-55a102b9067c sending to next pipeline
2026-03-24 18:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45f7710b-f590-5ee1-bec7-55a102b9067c, identifier: 1981519
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f08e5790>
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12aa9e70-1af9-5c3a-8dae-ee919f9464d7/12aa9e70-1af9-5c3a-8dae-ee919f9464d7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F02ed061d4fef4ea6996f1a8d15e70e52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/02ed061d4fef4ea6996f1a8d15e70e52/images/large/1.jpg saved to cache
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7
2026-03-24 18:34:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7, skipping ID generation
2026-03-24 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with scrape type 1
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 sending to next pipeline
2026-03-24 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7, identifier: 1981517
2026-03-24 18:34:32 [ayvens.es] INFO: Found listing with ID: 1981531
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981531%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [ayvens.es] INFO: Scrape type for 1981531: 1
2026-03-24 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1981531
2026-03-24 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3 with identifier: 1981531
2026-03-24 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3 with scrape type 1
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252Fb965de3b295248f88a9c184b3bac1d95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/b965de3b295248f88a9c184b3bac1d95/images/large/1.jpg not downloaded yet
2026-03-24 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45f7710b-f590-5ee1-bec7-55a102b9067c with identifier: 1981519
2026-03-24 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45f7710b-f590-5ee1-bec7-55a102b9067c with identifier: 1981519
2026-03-24 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45f7710b-f590-5ee1-bec7-55a102b9067c with identifier: 1981519 to the API
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/562/5ac4a78df54b4460bf35b35f22d87d54/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '45f7710b-f590-5ee1-bec7-55a102b9067c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 192454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f7710b-f590-5ee1-bec7-55a102b9067c/45f7710b-f590-5ee1-bec7-55a102b9067c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/5ac4a78df54b4460bf35b35f22d87d54/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981519%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [ayvens.es] INFO: Saving data for 1981519: {'created_time': 1774377272.399288, 'last_price_update_time': 1774377272.399297, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981519') HTTP/1.1" 204 0
2026-03-24 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1981517
2026-03-24 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1981517
2026-03-24 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1981517 to the API
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/511/02ed061d4fef4ea6996f1a8d15e70e52/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '12aa9e70-1af9-5c3a-8dae-ee919f9464d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 152107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12aa9e70-1af9-5c3a-8dae-ee919f9464d7/12aa9e70-1af9-5c3a-8dae-ee919f9464d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/511/02ed061d4fef4ea6996f1a8d15e70e52/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Last Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Last Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981517%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [ayvens.es] INFO: Saving data for 1981517: {'created_time': 1774377272.689104, 'last_price_update_time': 1774377272.689114, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981517') HTTP/1.1" 204 0
2026-03-24 18:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/916/2afcd86725df47cba86c847f2dad0cf6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/317/e72c581ba0ce4f72ab5bbd41a010dc7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:32 [ayvens.es] INFO: Found listing with ID: 1981532
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981532%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [ayvens.es] INFO: Scrape type for 1981532: 1
2026-03-24 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1981532
2026-03-24 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef with identifier: 1981532
2026-03-24 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef with scrape type 1
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F67a4f976b1704a1d89a68342ee225d31%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/67a4f976b1704a1d89a68342ee225d31/images/large/1.jpg not downloaded yet
2026-03-24 18:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/287/f9ae44389bf1415b93a5d36c64f6379f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:32 [ayvens.es] INFO: Found listing with ID: 1981533
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981533%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [ayvens.es] INFO: Scrape type for 1981533: 1
2026-03-24 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1981533
2026-03-24 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1981533
2026-03-24 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c10a9b1f-e475-51db-8bc9-8529a798339b with scrape type 1
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c10a9b1f-e475-51db-8bc9-8529a798339b
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F145%252Fc7d95bb68a7e4edeb2a01ee41f74b459%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/145/c7d95bb68a7e4edeb2a01ee41f74b459/images/large/1.jpg not downloaded yet
2026-03-24 18:34:32 [ayvens.es] INFO: Found listing with ID: 1981534
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981534%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [ayvens.es] INFO: Scrape type for 1981534: 1
2026-03-24 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1981534
2026-03-24 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1981534
2026-03-24 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4feaf296-8629-5274-931b-afe144cc432b with scrape type 1
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4feaf296-8629-5274-931b-afe144cc432b
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252F0c8f75aa696d4122b26d124e86432bd6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/0c8f75aa696d4122b26d124e86432bd6/images/large/1.jpg not downloaded yet
2026-03-24 18:34:32 [ayvens.es] INFO: Found listing with ID: 1981535
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981535%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [ayvens.es] INFO: Scrape type for 1981535: 1
2026-03-24 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1981535
2026-03-24 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc694ed-eb6f-56c6-9e24-e2de8319ef04 with identifier: 1981535
2026-03-24 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc694ed-eb6f-56c6-9e24-e2de8319ef04 with scrape type 1
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1cc694ed-eb6f-56c6-9e24-e2de8319ef04
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252Fd12760de1aa74cc5824702d7e4fe3cb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/d12760de1aa74cc5824702d7e4fe3cb3/images/large/1.jpg not downloaded yet
2026-03-24 18:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed44bd0>
2026-03-24 18:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e547614-e1c5-5271-b8e4-325cd575ffb3/1e547614-e1c5-5271-b8e4-325cd575ffb3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F916%252F2afcd86725df47cba86c847f2dad0cf6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/916/2afcd86725df47cba86c847f2dad0cf6/images/large/1.jpg saved to cache
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e547614-e1c5-5271-b8e4-325cd575ffb3
2026-03-24 18:34:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e547614-e1c5-5271-b8e4-325cd575ffb3, skipping ID generation
2026-03-24 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e547614-e1c5-5271-b8e4-325cd575ffb3 with scrape type 1
2026-03-24 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e547614-e1c5-5271-b8e4-325cd575ffb3 sending to next pipeline
2026-03-24 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1e547614-e1c5-5271-b8e4-325cd575ffb3, identifier: 1981521
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed357d0>
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70dfd836-86a8-5189-9bf7-6d09c20f4ef5/70dfd836-86a8-5189-9bf7-6d09c20f4ef5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252Fe72c581ba0ce4f72ab5bbd41a010dc7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/e72c581ba0ce4f72ab5bbd41a010dc7b/images/large/1.jpg saved to cache
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70dfd836-86a8-5189-9bf7-6d09c20f4ef5
2026-03-24 18:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70dfd836-86a8-5189-9bf7-6d09c20f4ef5, skipping ID generation
2026-03-24 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70dfd836-86a8-5189-9bf7-6d09c20f4ef5 with scrape type 1
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70dfd836-86a8-5189-9bf7-6d09c20f4ef5 sending to next pipeline
2026-03-24 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70dfd836-86a8-5189-9bf7-6d09c20f4ef5, identifier: 1981518
2026-03-24 18:34:33 [ayvens.es] INFO: Found listing with ID: 1981536
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981536%27 HTTP/1.1" 200 None
2026-03-24 18:34:33 [ayvens.es] INFO: Scrape type for 1981536: 1
2026-03-24 18:34:33 [ayvens.es] INFO: Extracting data for car ID: 1981536
2026-03-24 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b9f386a-1398-5518-b7e3-1666af3b8d40 with identifier: 1981536
2026-03-24 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b9f386a-1398-5518-b7e3-1666af3b8d40 with scrape type 1
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3b9f386a-1398-5518-b7e3-1666af3b8d40
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F114%252F2dc9ca7436be4707b03d83f8f873211c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/114/2dc9ca7436be4707b03d83f8f873211c/images/large/1.jpg not downloaded yet
2026-03-24 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1e547614-e1c5-5271-b8e4-325cd575ffb3 with identifier: 1981521
2026-03-24 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1e547614-e1c5-5271-b8e4-325cd575ffb3 with identifier: 1981521
2026-03-24 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1e547614-e1c5-5271-b8e4-325cd575ffb3 with identifier: 1981521 to the API
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/916/2afcd86725df47cba86c847f2dad0cf6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Rojo deseo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1e547614-e1c5-5271-b8e4-325cd575ffb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 62771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e547614-e1c5-5271-b8e4-325cd575ffb3/1e547614-e1c5-5271-b8e4-325cd575ffb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/916/2afcd86725df47cba86c847f2dad0cf6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Limited dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': '(O) Limited dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981521%27 HTTP/1.1" 200 None
2026-03-24 18:34:33 [ayvens.es] INFO: Saving data for 1981521: {'created_time': 1774377273.518025, 'last_price_update_time': 1774377273.518034, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981521') HTTP/1.1" 204 0
2026-03-24 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70dfd836-86a8-5189-9bf7-6d09c20f4ef5 with identifier: 1981518
2026-03-24 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70dfd836-86a8-5189-9bf7-6d09c20f4ef5 with identifier: 1981518
2026-03-24 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 70dfd836-86a8-5189-9bf7-6d09c20f4ef5 with identifier: 1981518 to the API
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/317/e72c581ba0ce4f72ab5bbd41a010dc7b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '70dfd836-86a8-5189-9bf7-6d09c20f4ef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 87158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dfd836-86a8-5189-9bf7-6d09c20f4ef5/70dfd836-86a8-5189-9bf7-6d09c20f4ef5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/317/e72c581ba0ce4f72ab5bbd41a010dc7b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Sport 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Sport 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981518%27 HTTP/1.1" 200 None
2026-03-24 18:34:33 [ayvens.es] INFO: Saving data for 1981518: {'created_time': 1774377273.795489, 'last_price_update_time': 1774377273.795499, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981518') HTTP/1.1" 204 0
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea31bd0>
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dc3e287-0217-5ea9-b7ad-c6bd639b2b46/2dc3e287-0217-5ea9-b7ad-c6bd639b2b46_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F287%252Ff9ae44389bf1415b93a5d36c64f6379f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/287/f9ae44389bf1415b93a5d36c64f6379f/images/large/1.jpg saved to cache
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46
2026-03-24 18:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46, skipping ID generation
2026-03-24 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46 with scrape type 1
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46 sending to next pipeline
2026-03-24 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46, identifier: 1981520
2026-03-24 18:34:33 [ayvens.es] INFO: Found listing with ID: 1981537
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981537%27 HTTP/1.1" 200 None
2026-03-24 18:34:33 [ayvens.es] INFO: Scrape type for 1981537: 1
2026-03-24 18:34:33 [ayvens.es] INFO: Extracting data for car ID: 1981537
2026-03-24 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60 with identifier: 1981537
2026-03-24 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60 with scrape type 1
2026-03-24 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F281%252F6ee7310f9d5f45228935a83d7a6854ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/281/6ee7310f9d5f45228935a83d7a6854ea/images/large/1.jpg not downloaded yet
2026-03-24 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46 with identifier: 1981520
2026-03-24 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46 with identifier: 1981520
2026-03-24 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2dc3e287-0217-5ea9-b7ad-c6bd639b2b46 with identifier: 1981520 to the API
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/287/f9ae44389bf1415b93a5d36c64f6379f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2dc3e287-0217-5ea9-b7ad-c6bd639b2b46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 114506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dc3e287-0217-5ea9-b7ad-c6bd639b2b46/2dc3e287-0217-5ea9-b7ad-c6bd639b2b46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/287/f9ae44389bf1415b93a5d36c64f6379f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981520%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [ayvens.es] INFO: Saving data for 1981520: {'created_time': 1774377274.30221, 'last_price_update_time': 1774377274.30222, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981520') HTTP/1.1" 204 0
2026-03-24 18:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/939/fd17cd88bf4c4bb3900ca9441130095e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:34 [ayvens.es] INFO: Found listing with ID: 1981538
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981538%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [ayvens.es] INFO: Scrape type for 1981538: 1
2026-03-24 18:34:34 [ayvens.es] INFO: Extracting data for car ID: 1981538
2026-03-24 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1981538
2026-03-24 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abac8b7-daad-5d28-a2b4-a39fc823c197 with scrape type 1
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6abac8b7-daad-5d28-a2b4-a39fc823c197
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F349942eff692412eafac73771134c926%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/349942eff692412eafac73771134c926/images/large/1.jpg not downloaded yet
2026-03-24 18:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/750/37be145e4b384aa999d8efe74d71bf87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:34 [ayvens.es] INFO: Found listing with ID: 1981539
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981539%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [ayvens.es] INFO: Scrape type for 1981539: 1
2026-03-24 18:34:34 [ayvens.es] INFO: Extracting data for car ID: 1981539
2026-03-24 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1981539
2026-03-24 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83746df7-f017-5bd5-8cba-981e0f55f2a5 with scrape type 1
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83746df7-f017-5bd5-8cba-981e0f55f2a5
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252Ff5fb8f6a60ce415ebd4476558b9e7870%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/f5fb8f6a60ce415ebd4476558b9e7870/images/large/1.jpg not downloaded yet
2026-03-24 18:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/365/5d0d4c56b4cc42ba8919de1a98e7d713/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/152/5b9e34d0d4524c4592cb00c4df283091/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/482/f3e270b5e1794bb4943cc157e1f97934/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:34 [ayvens.es] INFO: Found listing with ID: 1981540
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981540%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [ayvens.es] INFO: Scrape type for 1981540: 1
2026-03-24 18:34:34 [ayvens.es] INFO: Extracting data for car ID: 1981540
2026-03-24 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a041dc60-2755-5a00-a5f8-1dd3e7b28234 with identifier: 1981540
2026-03-24 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a041dc60-2755-5a00-a5f8-1dd3e7b28234 with scrape type 1
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a041dc60-2755-5a00-a5f8-1dd3e7b28234
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F836%252F8e9300ec51364a7a9d570cda5a33cb03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/836/8e9300ec51364a7a9d570cda5a33cb03/images/large/1.jpg not downloaded yet
2026-03-24 18:34:34 [ayvens.es] INFO: Found listing with ID: 1981541
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981541%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [ayvens.es] INFO: Scrape type for 1981541: 1
2026-03-24 18:34:34 [ayvens.es] INFO: Extracting data for car ID: 1981541
2026-03-24 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1981541
2026-03-24 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with scrape type 1
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252Fc1bbd6795e844e09a98a6eef839141f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/c1bbd6795e844e09a98a6eef839141f3/images/large/1.jpg not downloaded yet
2026-03-24 18:34:34 [ayvens.es] INFO: Found listing with ID: 1981542
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981542%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [ayvens.es] INFO: Scrape type for 1981542: 1
2026-03-24 18:34:34 [ayvens.es] INFO: Extracting data for car ID: 1981542
2026-03-24 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf171d7-ca0b-5d8b-aa4e-031ef441e151 with identifier: 1981542
2026-03-24 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf171d7-ca0b-5d8b-aa4e-031ef441e151 with scrape type 1
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2cf171d7-ca0b-5d8b-aa4e-031ef441e151
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F896%252F304870460ef84ba2a7c2d2cc042046f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/896/304870460ef84ba2a7c2d2cc042046f7/images/large/1.jpg not downloaded yet
2026-03-24 18:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9e3910>
2026-03-24 18:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2/1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F939%252Ffd17cd88bf4c4bb3900ca9441130095e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/939/fd17cd88bf4c4bb3900ca9441130095e/images/large/1.jpg saved to cache
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2
2026-03-24 18:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2, skipping ID generation
2026-03-24 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with scrape type 1
2026-03-24 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 sending to next pipeline
2026-03-24 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2, identifier: 1981524
2026-03-24 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1981524
2026-03-24 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1981524
2026-03-24 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1981524 to the API
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/939/fd17cd88bf4c4bb3900ca9441130095e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 127623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2/1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/939/fd17cd88bf4c4bb3900ca9441130095e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 81KW (110 CV) Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW (110 CV) Ambition',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981524%27 HTTP/1.1" 200 None
2026-03-24 18:34:34 [ayvens.es] INFO: Saving data for 1981524: {'created_time': 1774377274.962743, 'last_price_update_time': 1774377274.962758, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981524') HTTP/1.1" 204 0
2026-03-24 18:34:35 [ayvens.es] INFO: Found listing with ID: 1981543
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981543%27 HTTP/1.1" 200 None
2026-03-24 18:34:35 [ayvens.es] INFO: Scrape type for 1981543: 1
2026-03-24 18:34:35 [ayvens.es] INFO: Extracting data for car ID: 1981543
2026-03-24 18:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6836a946-4ffe-522b-a673-5b60d4fbea3d with identifier: 1981543
2026-03-24 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6836a946-4ffe-522b-a673-5b60d4fbea3d with scrape type 1
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6836a946-4ffe-522b-a673-5b60d4fbea3d
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fdca86280de084e7cb29b956f193f484e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/dca86280de084e7cb29b956f193f484e/images/large/1.jpg not downloaded yet
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef5fc10>
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_716fcb1c-ec4e-5f96-a1d6-440e56bef133/716fcb1c-ec4e-5f96-a1d6-440e56bef133_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F750%252F37be145e4b384aa999d8efe74d71bf87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/750/37be145e4b384aa999d8efe74d71bf87/images/large/1.jpg saved to cache
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 716fcb1c-ec4e-5f96-a1d6-440e56bef133
2026-03-24 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 716fcb1c-ec4e-5f96-a1d6-440e56bef133, skipping ID generation
2026-03-24 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 716fcb1c-ec4e-5f96-a1d6-440e56bef133 with scrape type 1
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 716fcb1c-ec4e-5f96-a1d6-440e56bef133 sending to next pipeline
2026-03-24 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 716fcb1c-ec4e-5f96-a1d6-440e56bef133, identifier: 1981525
2026-03-24 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 716fcb1c-ec4e-5f96-a1d6-440e56bef133 with identifier: 1981525
2026-03-24 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 716fcb1c-ec4e-5f96-a1d6-440e56bef133 with identifier: 1981525
2026-03-24 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 716fcb1c-ec4e-5f96-a1d6-440e56bef133 with identifier: 1981525 to the API
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/750/37be145e4b384aa999d8efe74d71bf87/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '716fcb1c-ec4e-5f96-a1d6-440e56bef133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 150514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_716fcb1c-ec4e-5f96-a1d6-440e56bef133/716fcb1c-ec4e-5f96-a1d6-440e56bef133_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/750/37be145e4b384aa999d8efe74d71bf87/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 TDI 110KW (150cv) DSG 4x2 Style',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW (150cv) DSG 4x2 Style',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981525%27 HTTP/1.1" 200 None
2026-03-24 18:34:35 [ayvens.es] INFO: Saving data for 1981525: {'created_time': 1774377275.52044, 'last_price_update_time': 1774377275.520453, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981525') HTTP/1.1" 204 0
2026-03-24 18:34:35 [ayvens.es] INFO: Found listing with ID: 1981544
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981544%27 HTTP/1.1" 200 None
2026-03-24 18:34:35 [ayvens.es] INFO: Scrape type for 1981544: 1
2026-03-24 18:34:35 [ayvens.es] INFO: Extracting data for car ID: 1981544
2026-03-24 18:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ffa0749-95da-59b2-8101-a9dba8b9ddab with identifier: 1981544
2026-03-24 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ffa0749-95da-59b2-8101-a9dba8b9ddab with scrape type 1
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ffa0749-95da-59b2-8101-a9dba8b9ddab
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252Fa446d5f367b14c4d948c1fc88fdc3d03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/a446d5f367b14c4d948c1fc88fdc3d03/images/large/1.jpg not downloaded yet
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1eb210>
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c580f71-6565-54e3-ad78-7822755cd3da/9c580f71-6565-54e3-ad78-7822755cd3da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252F5d0d4c56b4cc42ba8919de1a98e7d713%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/5d0d4c56b4cc42ba8919de1a98e7d713/images/large/1.jpg saved to cache
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c580f71-6565-54e3-ad78-7822755cd3da
2026-03-24 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c580f71-6565-54e3-ad78-7822755cd3da, skipping ID generation
2026-03-24 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c580f71-6565-54e3-ad78-7822755cd3da with scrape type 1
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c580f71-6565-54e3-ad78-7822755cd3da sending to next pipeline
2026-03-24 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9c580f71-6565-54e3-ad78-7822755cd3da, identifier: 1981522
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0fc990>
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59c33bb-1ddd-5e49-a7b8-dc050954c44d/f59c33bb-1ddd-5e49-a7b8-dc050954c44d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F152%252F5b9e34d0d4524c4592cb00c4df283091%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/152/5b9e34d0d4524c4592cb00c4df283091/images/large/1.jpg saved to cache
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d
2026-03-24 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59c33bb-1ddd-5e49-a7b8-dc050954c44d, skipping ID generation
2026-03-24 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d with scrape type 1
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d sending to next pipeline
2026-03-24 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f59c33bb-1ddd-5e49-a7b8-dc050954c44d, identifier: 1981523
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9e2890>
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1017ee0b-a992-5018-a328-9926375a70b3/1017ee0b-a992-5018-a328-9926375a70b3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252Ff3e270b5e1794bb4943cc157e1f97934%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/f3e270b5e1794bb4943cc157e1f97934/images/large/1.jpg saved to cache
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1017ee0b-a992-5018-a328-9926375a70b3
2026-03-24 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1017ee0b-a992-5018-a328-9926375a70b3, skipping ID generation
2026-03-24 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1017ee0b-a992-5018-a328-9926375a70b3 with scrape type 1
2026-03-24 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1017ee0b-a992-5018-a328-9926375a70b3 sending to next pipeline
2026-03-24 18:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1017ee0b-a992-5018-a328-9926375a70b3, identifier: 1981526
2026-03-24 18:34:36 [ayvens.es] INFO: Found listing with ID: 1981545
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981545%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [ayvens.es] INFO: Scrape type for 1981545: 1
2026-03-24 18:34:36 [ayvens.es] INFO: Extracting data for car ID: 1981545
2026-03-24 18:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1981545
2026-03-24 18:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64232063-89a5-5458-b0e6-60745ca7ef15 with scrape type 1
2026-03-24 18:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64232063-89a5-5458-b0e6-60745ca7ef15
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252F3cdce5c9bdbf4dc5a4be7006193b8371%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/3cdce5c9bdbf4dc5a4be7006193b8371/images/large/1.jpg not downloaded yet
2026-03-24 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1981522
2026-03-24 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1981522
2026-03-24 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1981522 to the API
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/365/5d0d4c56b4cc42ba8919de1a98e7d713/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9c580f71-6565-54e3-ad78-7822755cd3da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 21250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c580f71-6565-54e3-ad78-7822755cd3da/9c580f71-6565-54e3-ad78-7822755cd3da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/365/5d0d4c56b4cc42ba8919de1a98e7d713/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981522%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [ayvens.es] INFO: Saving data for 1981522: {'created_time': 1774377276.338321, 'last_price_update_time': 1774377276.338335, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981522') HTTP/1.1" 204 0
2026-03-24 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1981523
2026-03-24 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1981523
2026-03-24 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1981523 to the API
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/152/5b9e34d0d4524c4592cb00c4df283091/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco luna metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f59c33bb-1ddd-5e49-a7b8-dc050954c44d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 112867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59c33bb-1ddd-5e49-a7b8-dc050954c44d/f59c33bb-1ddd-5e49-a7b8-dc050954c44d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/152/5b9e34d0d4524c4592cb00c4df283091/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981523%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [ayvens.es] INFO: Saving data for 1981523: {'created_time': 1774377276.63985, 'last_price_update_time': 1774377276.639863, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981523') HTTP/1.1" 204 0
2026-03-24 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1981526
2026-03-24 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1981526
2026-03-24 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1981526 to the API
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/482/f3e270b5e1794bb4943cc157e1f97934/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1017ee0b-a992-5018-a328-9926375a70b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 76114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1017ee0b-a992-5018-a328-9926375a70b3/1017ee0b-a992-5018-a328-9926375a70b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/482/f3e270b5e1794bb4943cc157e1f97934/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 (O) 2.0 D3',
 'transmission': 'manual',
 'trim': '(O) 2.0 D3',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981526%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [ayvens.es] INFO: Saving data for 1981526: {'created_time': 1774377276.911785, 'last_price_update_time': 1774377276.911797, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981526') HTTP/1.1" 204 0
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/626/9781839b70cd40f6a5b8f15653da06bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/558/90081b1c2fbd4d28bd0d4f2eef2652cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/638/b965de3b295248f88a9c184b3bac1d95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/869/b2032fae02bb4bbd986712f4126da28e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/342/67a4f976b1704a1d89a68342ee225d31/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [ayvens.es] INFO: Found listing with ID: 1981546
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981546%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [ayvens.es] INFO: Scrape type for 1981546: 1
2026-03-24 18:34:36 [ayvens.es] INFO: Extracting data for car ID: 1981546
2026-03-24 18:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d1c9ce-9c7d-540d-825a-944cbf8315bf with identifier: 1981546
2026-03-24 18:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d1c9ce-9c7d-540d-825a-944cbf8315bf with scrape type 1
2026-03-24 18:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a1d1c9ce-9c7d-540d-825a-944cbf8315bf
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F989%252F8eb5165dd9ce4a8092dbf7ae6618fc0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/989/8eb5165dd9ce4a8092dbf7ae6618fc0f/images/large/1.jpg not downloaded yet
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/334/0c8f75aa696d4122b26d124e86432bd6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/656/f473a0f9c94f4cc49a422efb87714266/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/145/c7d95bb68a7e4edeb2a01ee41f74b459/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:36 [ayvens.es] INFO: Found listing with ID: 1981547
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981547%27 HTTP/1.1" 200 None
2026-03-24 18:34:36 [ayvens.es] INFO: Scrape type for 1981547: 1
2026-03-24 18:34:36 [ayvens.es] INFO: Extracting data for car ID: 1981547
2026-03-24 18:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1981547
2026-03-24 18:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e6966f-01b1-55f0-8985-2351fa853a49 with scrape type 1
2026-03-24 18:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 20e6966f-01b1-55f0-8985-2351fa853a49
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252Fb1fd2bf57f7a4dd29cfc63005cd37075%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/b1fd2bf57f7a4dd29cfc63005cd37075/images/large/1.jpg not downloaded yet
2026-03-24 18:34:37 [ayvens.es] INFO: Found listing with ID: 1981548
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981548%27 HTTP/1.1" 200 None
2026-03-24 18:34:37 [ayvens.es] INFO: Scrape type for 1981548: 1
2026-03-24 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1981548
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d62da4-d46c-548d-ba8f-c9e37cdc2dad with identifier: 1981548
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d62da4-d46c-548d-ba8f-c9e37cdc2dad with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 93d62da4-d46c-548d-ba8f-c9e37cdc2dad
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F932%252F598a0fd9f3944eb48066acd49ba3d2fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/932/598a0fd9f3944eb48066acd49ba3d2fa/images/large/1.jpg not downloaded yet
2026-03-24 18:34:37 [ayvens.es] INFO: Found listing with ID: 1981549
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981549%27 HTTP/1.1" 200 None
2026-03-24 18:34:37 [ayvens.es] INFO: Scrape type for 1981549: 1
2026-03-24 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1981549
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1981549
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca96feed-a9b2-5da4-898f-921fbbcf8558 with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca96feed-a9b2-5da4-898f-921fbbcf8558
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252F24a117ffdf9f460789b8132b61c5942a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/24a117ffdf9f460789b8132b61c5942a/images/large/1.jpg not downloaded yet
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6e31d0>
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88d5a0d-9535-514a-bbd1-c7fdbd193c61/d88d5a0d-9535-514a-bbd1-c7fdbd193c61_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F9781839b70cd40f6a5b8f15653da06bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/9781839b70cd40f6a5b8f15653da06bb/images/large/1.jpg saved to cache
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d88d5a0d-9535-514a-bbd1-c7fdbd193c61, skipping ID generation
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61 sending to next pipeline
2026-03-24 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d88d5a0d-9535-514a-bbd1-c7fdbd193c61, identifier: 1981530
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee914590>
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f6d42-ac12-57e4-94d1-47f4eef66598/1e7f6d42-ac12-57e4-94d1-47f4eef66598_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F90081b1c2fbd4d28bd0d4f2eef2652cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/90081b1c2fbd4d28bd0d4f2eef2652cc/images/large/1.jpg saved to cache
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e7f6d42-ac12-57e4-94d1-47f4eef66598, skipping ID generation
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598 sending to next pipeline
2026-03-24 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1e7f6d42-ac12-57e4-94d1-47f4eef66598, identifier: 1981529
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecf2a90>
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa7ac5b-eb75-51c7-aa24-593a0aef95b3/0aa7ac5b-eb75-51c7-aa24-593a0aef95b3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252Fb965de3b295248f88a9c184b3bac1d95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/b965de3b295248f88a9c184b3bac1d95/images/large/1.jpg saved to cache
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3, skipping ID generation
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3 with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3 sending to next pipeline
2026-03-24 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3, identifier: 1981531
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7b9d90>
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b6c8ef-d306-5710-9b69-a80d8c392cd9/64b6c8ef-d306-5710-9b69-a80d8c392cd9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252Fb2032fae02bb4bbd986712f4126da28e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/b2032fae02bb4bbd986712f4126da28e/images/large/1.jpg saved to cache
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64b6c8ef-d306-5710-9b69-a80d8c392cd9
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64b6c8ef-d306-5710-9b69-a80d8c392cd9, skipping ID generation
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b6c8ef-d306-5710-9b69-a80d8c392cd9 with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64b6c8ef-d306-5710-9b69-a80d8c392cd9 sending to next pipeline
2026-03-24 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 64b6c8ef-d306-5710-9b69-a80d8c392cd9, identifier: 1981528
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8f8590>
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef/b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F67a4f976b1704a1d89a68342ee225d31%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/67a4f976b1704a1d89a68342ee225d31/images/large/1.jpg saved to cache
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef, skipping ID generation
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef sending to next pipeline
2026-03-24 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef, identifier: 1981532
2026-03-24 18:34:37 [ayvens.es] INFO: Found listing with ID: 1981550
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981550%27 HTTP/1.1" 200 None
2026-03-24 18:34:37 [ayvens.es] INFO: Scrape type for 1981550: 1
2026-03-24 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1981550
2026-03-24 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1981550
2026-03-24 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b with scrape type 1
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F470%252F4603687768994d77bac27c81ebb4dd10%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/470/4603687768994d77bac27c81ebb4dd10/images/large/1.jpg not downloaded yet
2026-03-24 18:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1981530
2026-03-24 18:34:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1981530
2026-03-24 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1981530 to the API
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/626/9781839b70cd40f6a5b8f15653da06bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Gris manhattan',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd88d5a0d-9535-514a-bbd1-c7fdbd193c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 105939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88d5a0d-9535-514a-bbd1-c7fdbd193c61/d88d5a0d-9535-514a-bbd1-c7fdbd193c61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/626/9781839b70cd40f6a5b8f15653da06bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981530%27 HTTP/1.1" 200 None
2026-03-24 18:34:38 [ayvens.es] INFO: Saving data for 1981530: {'created_time': 1774377278.300099, 'last_price_update_time': 1774377278.300109, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981530') HTTP/1.1" 204 0
2026-03-24 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1981529
2026-03-24 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1981529
2026-03-24 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1981529 to the API
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/558/90081b1c2fbd4d28bd0d4f2eef2652cc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1e7f6d42-ac12-57e4-94d1-47f4eef66598',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 90948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7f6d42-ac12-57e4-94d1-47f4eef66598/1e7f6d42-ac12-57e4-94d1-47f4eef66598_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/558/90081b1c2fbd4d28bd0d4f2eef2652cc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981529%27 HTTP/1.1" 200 None
2026-03-24 18:34:38 [ayvens.es] INFO: Saving data for 1981529: {'created_time': 1774377278.61939, 'last_price_update_time': 1774377278.619402, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981529') HTTP/1.1" 204 0
2026-03-24 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3 with identifier: 1981531
2026-03-24 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3 with identifier: 1981531
2026-03-24 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0aa7ac5b-eb75-51c7-aa24-593a0aef95b3 with identifier: 1981531 to the API
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/638/b965de3b295248f88a9c184b3bac1d95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris platinum metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0aa7ac5b-eb75-51c7-aa24-593a0aef95b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 127436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa7ac5b-eb75-51c7-aa24-593a0aef95b3/0aa7ac5b-eb75-51c7-aa24-593a0aef95b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/638/b965de3b295248f88a9c184b3bac1d95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style BlueHDi 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Style BlueHDi 130 S&S',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981531%27 HTTP/1.1" 200 None
2026-03-24 18:34:38 [ayvens.es] INFO: Saving data for 1981531: {'created_time': 1774377278.968199, 'last_price_update_time': 1774377278.968212, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981531') HTTP/1.1" 204 0
2026-03-24 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 64b6c8ef-d306-5710-9b69-a80d8c392cd9 with identifier: 1981528
2026-03-24 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 64b6c8ef-d306-5710-9b69-a80d8c392cd9 with identifier: 1981528
2026-03-24 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 64b6c8ef-d306-5710-9b69-a80d8c392cd9 with identifier: 1981528 to the API
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/869/b2032fae02bb4bbd986712f4126da28e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '64b6c8ef-d306-5710-9b69-a80d8c392cd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 158218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b6c8ef-d306-5710-9b69-a80d8c392cd9/64b6c8ef-d306-5710-9b69-a80d8c392cd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/869/b2032fae02bb4bbd986712f4126da28e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA Combi 2.0 TDI 85kW(115CV) Man Ambition',
 'transmission': 'manual',
 'trim': 'Combi 2.0 TDI 85kW(115CV) Man Ambition',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981528%27 HTTP/1.1" 200 None
2026-03-24 18:34:39 [ayvens.es] INFO: Saving data for 1981528: {'created_time': 1774377279.289872, 'last_price_update_time': 1774377279.289883, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981528') HTTP/1.1" 204 0
2026-03-24 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef with identifier: 1981532
2026-03-24 18:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef with identifier: 1981532
2026-03-24 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef with identifier: 1981532 to the API
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/342/67a4f976b1704a1d89a68342ee225d31/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 250507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef/b12dc71f-4c77-5dff-a0d1-5accdb7bd0ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/342/67a4f976b1704a1d89a68342ee225d31/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981532%27 HTTP/1.1" 200 None
2026-03-24 18:34:39 [ayvens.es] INFO: Saving data for 1981532: {'created_time': 1774377279.618898, 'last_price_update_time': 1774377279.61891, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981532') HTTP/1.1" 204 0
2026-03-24 18:34:39 [ayvens.es] INFO: Found listing with ID: 1981551
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981551%27 HTTP/1.1" 200 None
2026-03-24 18:34:39 [ayvens.es] INFO: Scrape type for 1981551: 1
2026-03-24 18:34:39 [ayvens.es] INFO: Extracting data for car ID: 1981551
2026-03-24 18:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1981551
2026-03-24 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1484a54-6b3a-575e-b277-4a549ffeecaf with scrape type 1
2026-03-24 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1484a54-6b3a-575e-b277-4a549ffeecaf
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fdecc5d74150144dba92280d6e4bca87a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/decc5d74150144dba92280d6e4bca87a/images/large/1.jpg not downloaded yet
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea58e10>
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4feaf296-8629-5274-931b-afe144cc432b/4feaf296-8629-5274-931b-afe144cc432b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252F0c8f75aa696d4122b26d124e86432bd6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/0c8f75aa696d4122b26d124e86432bd6/images/large/1.jpg saved to cache
2026-03-24 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4feaf296-8629-5274-931b-afe144cc432b
2026-03-24 18:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4feaf296-8629-5274-931b-afe144cc432b, skipping ID generation
2026-03-24 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4feaf296-8629-5274-931b-afe144cc432b with scrape type 1
2026-03-24 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4feaf296-8629-5274-931b-afe144cc432b sending to next pipeline
2026-03-24 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4feaf296-8629-5274-931b-afe144cc432b, identifier: 1981534
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee0cd10>
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763093c1-5d8f-503c-b86a-bf80bcb1764b/763093c1-5d8f-503c-b86a-bf80bcb1764b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F656%252Ff473a0f9c94f4cc49a422efb87714266%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/656/f473a0f9c94f4cc49a422efb87714266/images/large/1.jpg saved to cache
2026-03-24 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 763093c1-5d8f-503c-b86a-bf80bcb1764b
2026-03-24 18:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 763093c1-5d8f-503c-b86a-bf80bcb1764b, skipping ID generation
2026-03-24 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 763093c1-5d8f-503c-b86a-bf80bcb1764b with scrape type 1
2026-03-24 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 763093c1-5d8f-503c-b86a-bf80bcb1764b sending to next pipeline
2026-03-24 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 763093c1-5d8f-503c-b86a-bf80bcb1764b, identifier: 1981527
2026-03-24 18:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee0ead0>
2026-03-24 18:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c10a9b1f-e475-51db-8bc9-8529a798339b/c10a9b1f-e475-51db-8bc9-8529a798339b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F145%252Fc7d95bb68a7e4edeb2a01ee41f74b459%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/145/c7d95bb68a7e4edeb2a01ee41f74b459/images/large/1.jpg saved to cache
2026-03-24 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c10a9b1f-e475-51db-8bc9-8529a798339b
2026-03-24 18:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c10a9b1f-e475-51db-8bc9-8529a798339b, skipping ID generation
2026-03-24 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c10a9b1f-e475-51db-8bc9-8529a798339b with scrape type 1
2026-03-24 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c10a9b1f-e475-51db-8bc9-8529a798339b sending to next pipeline
2026-03-24 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c10a9b1f-e475-51db-8bc9-8529a798339b, identifier: 1981533
2026-03-24 18:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/114/2dc9ca7436be4707b03d83f8f873211c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/132/d12760de1aa74cc5824702d7e4fe3cb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1981534
2026-03-24 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1981534
2026-03-24 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1981534 to the API
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/334/0c8f75aa696d4122b26d124e86432bd6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4feaf296-8629-5274-931b-afe144cc432b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 121884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4feaf296-8629-5274-931b-afe144cc432b/4feaf296-8629-5274-931b-afe144cc432b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/0c8f75aa696d4122b26d124e86432bd6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 125 S-Edition',
 'transmission': 'manual',
 'trim': '1.5 125 S-Edition',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981534%27 HTTP/1.1" 200 None
2026-03-24 18:34:40 [ayvens.es] INFO: Saving data for 1981534: {'created_time': 1774377280.593621, 'last_price_update_time': 1774377280.593631, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981534') HTTP/1.1" 204 0
2026-03-24 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 763093c1-5d8f-503c-b86a-bf80bcb1764b with identifier: 1981527
2026-03-24 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 763093c1-5d8f-503c-b86a-bf80bcb1764b with identifier: 1981527
2026-03-24 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 763093c1-5d8f-503c-b86a-bf80bcb1764b with identifier: 1981527 to the API
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/656/f473a0f9c94f4cc49a422efb87714266/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '763093c1-5d8f-503c-b86a-bf80bcb1764b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 76787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763093c1-5d8f-503c-b86a-bf80bcb1764b/763093c1-5d8f-503c-b86a-bf80bcb1764b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/656/f473a0f9c94f4cc49a422efb87714266/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 66kW (90CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 66kW (90CV) -18',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981527%27 HTTP/1.1" 200 None
2026-03-24 18:34:40 [ayvens.es] INFO: Saving data for 1981527: {'created_time': 1774377280.863656, 'last_price_update_time': 1774377280.863665, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981527') HTTP/1.1" 204 0
2026-03-24 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1981533
2026-03-24 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1981533
2026-03-24 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1981533 to the API
2026-03-24 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/145/c7d95bb68a7e4edeb2a01ee41f74b459/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c10a9b1f-e475-51db-8bc9-8529a798339b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 171863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c10a9b1f-e475-51db-8bc9-8529a798339b/c10a9b1f-e475-51db-8bc9-8529a798339b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/145/c7d95bb68a7e4edeb2a01ee41f74b459/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981533%27 HTTP/1.1" 200 None
2026-03-24 18:34:41 [ayvens.es] INFO: Saving data for 1981533: {'created_time': 1774377281.183354, 'last_price_update_time': 1774377281.183363, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981533') HTTP/1.1" 204 0
2026-03-24 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/302/f5fb8f6a60ce415ebd4476558b9e7870/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/836/8e9300ec51364a7a9d570cda5a33cb03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/896/304870460ef84ba2a7c2d2cc042046f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:41 [ayvens.es] INFO: Found listing with ID: 1981552
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981552%27 HTTP/1.1" 200 None
2026-03-24 18:34:41 [ayvens.es] INFO: Scrape type for 1981552: 1
2026-03-24 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1981552
2026-03-24 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd463c99-308b-5fcd-9d1f-599eb1f6335e with identifier: 1981552
2026-03-24 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd463c99-308b-5fcd-9d1f-599eb1f6335e with scrape type 1
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dd463c99-308b-5fcd-9d1f-599eb1f6335e
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F01723d368c1a4a8caef2d8c832c21837%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/01723d368c1a4a8caef2d8c832c21837/images/large/1.jpg not downloaded yet
2026-03-24 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/189/c1bbd6795e844e09a98a6eef839141f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:41 [ayvens.es] INFO: Found listing with ID: 1981553
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981553%27 HTTP/1.1" 200 None
2026-03-24 18:34:41 [ayvens.es] INFO: Scrape type for 1981553: 1
2026-03-24 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1981553
2026-03-24 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1981553
2026-03-24 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2452118-a699-595a-a9c9-afbf9c6e6419 with scrape type 1
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d2452118-a699-595a-a9c9-afbf9c6e6419
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252Fbabbe578a30c4344b7ed59b835732e4a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/babbe578a30c4344b7ed59b835732e4a/images/large/1.jpg not downloaded yet
2026-03-24 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/281/6ee7310f9d5f45228935a83d7a6854ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/142/349942eff692412eafac73771134c926/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee94b490>
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f386a-1398-5518-b7e3-1666af3b8d40/3b9f386a-1398-5518-b7e3-1666af3b8d40_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F114%252F2dc9ca7436be4707b03d83f8f873211c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/114/2dc9ca7436be4707b03d83f8f873211c/images/large/1.jpg saved to cache
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b9f386a-1398-5518-b7e3-1666af3b8d40
2026-03-24 18:34:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b9f386a-1398-5518-b7e3-1666af3b8d40, skipping ID generation
2026-03-24 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b9f386a-1398-5518-b7e3-1666af3b8d40 with scrape type 1
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b9f386a-1398-5518-b7e3-1666af3b8d40 sending to next pipeline
2026-03-24 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3b9f386a-1398-5518-b7e3-1666af3b8d40, identifier: 1981536
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed4b590>
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc694ed-eb6f-56c6-9e24-e2de8319ef04/1cc694ed-eb6f-56c6-9e24-e2de8319ef04_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252Fd12760de1aa74cc5824702d7e4fe3cb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/d12760de1aa74cc5824702d7e4fe3cb3/images/large/1.jpg saved to cache
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cc694ed-eb6f-56c6-9e24-e2de8319ef04
2026-03-24 18:34:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cc694ed-eb6f-56c6-9e24-e2de8319ef04, skipping ID generation
2026-03-24 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc694ed-eb6f-56c6-9e24-e2de8319ef04 with scrape type 1
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cc694ed-eb6f-56c6-9e24-e2de8319ef04 sending to next pipeline
2026-03-24 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1cc694ed-eb6f-56c6-9e24-e2de8319ef04, identifier: 1981535
2026-03-24 18:34:41 [ayvens.es] INFO: Found listing with ID: 1981554
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981554%27 HTTP/1.1" 200 None
2026-03-24 18:34:41 [ayvens.es] INFO: Scrape type for 1981554: 1
2026-03-24 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1981554
2026-03-24 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1981554
2026-03-24 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with scrape type 1
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252Fb1053f0e873b40ef86f20cc045340540%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/b1053f0e873b40ef86f20cc045340540/images/large/1.jpg not downloaded yet
2026-03-24 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3b9f386a-1398-5518-b7e3-1666af3b8d40 with identifier: 1981536
2026-03-24 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3b9f386a-1398-5518-b7e3-1666af3b8d40 with identifier: 1981536
2026-03-24 18:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3b9f386a-1398-5518-b7e3-1666af3b8d40 with identifier: 1981536 to the API
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/114/2dc9ca7436be4707b03d83f8f873211c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Plata metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3b9f386a-1398-5518-b7e3-1666af3b8d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 275275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f386a-1398-5518-b7e3-1666af3b8d40/3b9f386a-1398-5518-b7e3-1666af3b8d40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/114/2dc9ca7436be4707b03d83f8f873211c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981536%27 HTTP/1.1" 200 None
2026-03-24 18:34:42 [ayvens.es] INFO: Saving data for 1981536: {'created_time': 1774377282.08033, 'last_price_update_time': 1774377282.080342, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981536') HTTP/1.1" 204 0
2026-03-24 18:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1cc694ed-eb6f-56c6-9e24-e2de8319ef04 with identifier: 1981535
2026-03-24 18:34:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1cc694ed-eb6f-56c6-9e24-e2de8319ef04 with identifier: 1981535
2026-03-24 18:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1cc694ed-eb6f-56c6-9e24-e2de8319ef04 with identifier: 1981535 to the API
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/132/d12760de1aa74cc5824702d7e4fe3cb3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1cc694ed-eb6f-56c6-9e24-e2de8319ef04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 177198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc694ed-eb6f-56c6-9e24-e2de8319ef04/1cc694ed-eb6f-56c6-9e24-e2de8319ef04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/132/d12760de1aa74cc5824702d7e4fe3cb3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Business Line BlueHDi 130 EAT8',
 'transmission': 'manual',
 'trim': '5P Business Line BlueHDi 130 EAT8',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981535%27 HTTP/1.1" 200 None
2026-03-24 18:34:42 [ayvens.es] INFO: Saving data for 1981535: {'created_time': 1774377282.496195, 'last_price_update_time': 1774377282.496204, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981535') HTTP/1.1" 204 0
2026-03-24 18:34:42 [ayvens.es] INFO: Found listing with ID: 1981555
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981555%27 HTTP/1.1" 200 None
2026-03-24 18:34:42 [ayvens.es] INFO: Scrape type for 1981555: 1
2026-03-24 18:34:42 [ayvens.es] INFO: Extracting data for car ID: 1981555
2026-03-24 18:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1981555
2026-03-24 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356b6385-5c14-5168-8787-25febf5f7989 with scrape type 1
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 356b6385-5c14-5168-8787-25febf5f7989
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252F67312f4d2ba640a9819aa811a80f904e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/67312f4d2ba640a9819aa811a80f904e/images/large/1.jpg not downloaded yet
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee948b90>
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83746df7-f017-5bd5-8cba-981e0f55f2a5/83746df7-f017-5bd5-8cba-981e0f55f2a5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252Ff5fb8f6a60ce415ebd4476558b9e7870%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/f5fb8f6a60ce415ebd4476558b9e7870/images/large/1.jpg saved to cache
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83746df7-f017-5bd5-8cba-981e0f55f2a5
2026-03-24 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83746df7-f017-5bd5-8cba-981e0f55f2a5, skipping ID generation
2026-03-24 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83746df7-f017-5bd5-8cba-981e0f55f2a5 with scrape type 1
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83746df7-f017-5bd5-8cba-981e0f55f2a5 sending to next pipeline
2026-03-24 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 83746df7-f017-5bd5-8cba-981e0f55f2a5, identifier: 1981539
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeb23a10>
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a041dc60-2755-5a00-a5f8-1dd3e7b28234/a041dc60-2755-5a00-a5f8-1dd3e7b28234_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F836%252F8e9300ec51364a7a9d570cda5a33cb03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/836/8e9300ec51364a7a9d570cda5a33cb03/images/large/1.jpg saved to cache
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a041dc60-2755-5a00-a5f8-1dd3e7b28234
2026-03-24 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a041dc60-2755-5a00-a5f8-1dd3e7b28234, skipping ID generation
2026-03-24 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a041dc60-2755-5a00-a5f8-1dd3e7b28234 with scrape type 1
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a041dc60-2755-5a00-a5f8-1dd3e7b28234 sending to next pipeline
2026-03-24 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a041dc60-2755-5a00-a5f8-1dd3e7b28234, identifier: 1981540
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7b8090>
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cf171d7-ca0b-5d8b-aa4e-031ef441e151/2cf171d7-ca0b-5d8b-aa4e-031ef441e151_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F896%252F304870460ef84ba2a7c2d2cc042046f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/896/304870460ef84ba2a7c2d2cc042046f7/images/large/1.jpg saved to cache
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cf171d7-ca0b-5d8b-aa4e-031ef441e151
2026-03-24 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cf171d7-ca0b-5d8b-aa4e-031ef441e151, skipping ID generation
2026-03-24 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf171d7-ca0b-5d8b-aa4e-031ef441e151 with scrape type 1
2026-03-24 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cf171d7-ca0b-5d8b-aa4e-031ef441e151 sending to next pipeline
2026-03-24 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2cf171d7-ca0b-5d8b-aa4e-031ef441e151, identifier: 1981542
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecc97d0>
2026-03-24 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faf79212-c74e-50a6-8eb5-ece7c8db8ba1/faf79212-c74e-50a6-8eb5-ece7c8db8ba1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252Fc1bbd6795e844e09a98a6eef839141f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/c1bbd6795e844e09a98a6eef839141f3/images/large/1.jpg saved to cache
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1
2026-03-24 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faf79212-c74e-50a6-8eb5-ece7c8db8ba1, skipping ID generation
2026-03-24 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with scrape type 1
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1 sending to next pipeline
2026-03-24 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: faf79212-c74e-50a6-8eb5-ece7c8db8ba1, identifier: 1981541
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eeafd690>
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60/fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F281%252F6ee7310f9d5f45228935a83d7a6854ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/281/6ee7310f9d5f45228935a83d7a6854ea/images/large/1.jpg saved to cache
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60
2026-03-24 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60, skipping ID generation
2026-03-24 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60 with scrape type 1
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60 sending to next pipeline
2026-03-24 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60, identifier: 1981537
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef282250>
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abac8b7-daad-5d28-a2b4-a39fc823c197/6abac8b7-daad-5d28-a2b4-a39fc823c197_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F349942eff692412eafac73771134c926%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/349942eff692412eafac73771134c926/images/large/1.jpg saved to cache
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6abac8b7-daad-5d28-a2b4-a39fc823c197
2026-03-24 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6abac8b7-daad-5d28-a2b4-a39fc823c197, skipping ID generation
2026-03-24 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abac8b7-daad-5d28-a2b4-a39fc823c197 with scrape type 1
2026-03-24 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6abac8b7-daad-5d28-a2b4-a39fc823c197 sending to next pipeline
2026-03-24 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6abac8b7-daad-5d28-a2b4-a39fc823c197, identifier: 1981538
2026-03-24 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1981539
2026-03-24 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1981539
2026-03-24 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1981539 to the API
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/302/f5fb8f6a60ce415ebd4476558b9e7870/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Negro onyx',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '83746df7-f017-5bd5-8cba-981e0f55f2a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 73442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83746df7-f017-5bd5-8cba-981e0f55f2a5/83746df7-f017-5bd5-8cba-981e0f55f2a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/302/f5fb8f6a60ce415ebd4476558b9e7870/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 (O) 2.0 D4 AWD Business Plus Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D4 AWD Business Plus Auto',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981539%27 HTTP/1.1" 200 None
2026-03-24 18:34:43 [ayvens.es] INFO: Saving data for 1981539: {'created_time': 1774377283.900405, 'last_price_update_time': 1774377283.900416, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981539') HTTP/1.1" 204 0
2026-03-24 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a041dc60-2755-5a00-a5f8-1dd3e7b28234 with identifier: 1981540
2026-03-24 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a041dc60-2755-5a00-a5f8-1dd3e7b28234 with identifier: 1981540
2026-03-24 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a041dc60-2755-5a00-a5f8-1dd3e7b28234 with identifier: 1981540 to the API
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/836/8e9300ec51364a7a9d570cda5a33cb03/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Negro parla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a041dc60-2755-5a00-a5f8-1dd3e7b28234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 184179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a041dc60-2755-5a00-a5f8-1dd3e7b28234/a041dc60-2755-5a00-a5f8-1dd3e7b28234_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/836/8e9300ec51364a7a9d570cda5a33cb03/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack PureTech 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack PureTech 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981540%27 HTTP/1.1" 200 None
2026-03-24 18:34:44 [ayvens.es] INFO: Saving data for 1981540: {'created_time': 1774377284.24885, 'last_price_update_time': 1774377284.248865, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981540') HTTP/1.1" 204 0
2026-03-24 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2cf171d7-ca0b-5d8b-aa4e-031ef441e151 with identifier: 1981542
2026-03-24 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2cf171d7-ca0b-5d8b-aa4e-031ef441e151 with identifier: 1981542
2026-03-24 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2cf171d7-ca0b-5d8b-aa4e-031ef441e151 with identifier: 1981542 to the API
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/896/304870460ef84ba2a7c2d2cc042046f7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2cf171d7-ca0b-5d8b-aa4e-031ef441e151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 128979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cf171d7-ca0b-5d8b-aa4e-031ef441e151/2cf171d7-ca0b-5d8b-aa4e-031ef441e151_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/896/304870460ef84ba2a7c2d2cc042046f7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981542%27 HTTP/1.1" 200 None
2026-03-24 18:34:44 [ayvens.es] INFO: Saving data for 1981542: {'created_time': 1774377284.558585, 'last_price_update_time': 1774377284.558597, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981542') HTTP/1.1" 204 0
2026-03-24 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1981541
2026-03-24 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1981541
2026-03-24 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1981541 to the API
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/189/c1bbd6795e844e09a98a6eef839141f3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Azul makro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'faf79212-c74e-50a6-8eb5-ece7c8db8ba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 134232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faf79212-c74e-50a6-8eb5-ece7c8db8ba1/faf79212-c74e-50a6-8eb5-ece7c8db8ba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/189/c1bbd6795e844e09a98a6eef839141f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2018}
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981541%27 HTTP/1.1" 200 None
2026-03-24 18:34:44 [ayvens.es] INFO: Saving data for 1981541: {'created_time': 1774377284.852191, 'last_price_update_time': 1774377284.852205, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981541') HTTP/1.1" 204 0
2026-03-24 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60 with identifier: 1981537
2026-03-24 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60 with identifier: 1981537
2026-03-24 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60 with identifier: 1981537 to the API
2026-03-24 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/281/6ee7310f9d5f45228935a83d7a6854ea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 116589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60/fcd4dac9-fd17-5de2-a8e0-8c2c7d960d60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/281/6ee7310f9d5f45228935a83d7a6854ea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981537%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [ayvens.es] INFO: Saving data for 1981537: {'created_time': 1774377285.205455, 'last_price_update_time': 1774377285.205466, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981537') HTTP/1.1" 204 0
2026-03-24 18:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1981538
2026-03-24 18:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1981538
2026-03-24 18:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1981538 to the API
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/142/349942eff692412eafac73771134c926/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6abac8b7-daad-5d28-a2b4-a39fc823c197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 79905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abac8b7-daad-5d28-a2b4-a39fc823c197/6abac8b7-daad-5d28-a2b4-a39fc823c197_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/142/349942eff692412eafac73771134c926/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981538%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [ayvens.es] INFO: Saving data for 1981538: {'created_time': 1774377285.564927, 'last_price_update_time': 1774377285.564937, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981538') HTTP/1.1" 204 0
2026-03-24 18:34:45 [ayvens.es] INFO: Found listing with ID: 1981556
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981556%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [ayvens.es] INFO: Scrape type for 1981556: 1
2026-03-24 18:34:45 [ayvens.es] INFO: Extracting data for car ID: 1981556
2026-03-24 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 116b50bf-76c6-5f3c-b8d2-1a813a621f70 with identifier: 1981556
2026-03-24 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 116b50bf-76c6-5f3c-b8d2-1a813a621f70 with scrape type 1
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 116b50bf-76c6-5f3c-b8d2-1a813a621f70
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fa19a45aab7c847dcb8f9f45579983a39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/a19a45aab7c847dcb8f9f45579983a39/images/large/1.jpg not downloaded yet
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/047/b1fd2bf57f7a4dd29cfc63005cd37075/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/932/598a0fd9f3944eb48066acd49ba3d2fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/567/dca86280de084e7cb29b956f193f484e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [ayvens.es] INFO: Found listing with ID: 1981557
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981557%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [ayvens.es] INFO: Scrape type for 1981557: 1
2026-03-24 18:34:45 [ayvens.es] INFO: Extracting data for car ID: 1981557
2026-03-24 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 813aa247-ff33-53b0-92f7-74751a918d74 with identifier: 1981557
2026-03-24 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 813aa247-ff33-53b0-92f7-74751a918d74 with scrape type 1
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 813aa247-ff33-53b0-92f7-74751a918d74
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F203%252F117582df99b144e78adf2401a48930f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/203/117582df99b144e78adf2401a48930f6/images/large/1.jpg not downloaded yet
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/667/24a117ffdf9f460789b8132b61c5942a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/989/8eb5165dd9ce4a8092dbf7ae6618fc0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/068/3cdce5c9bdbf4dc5a4be7006193b8371/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [ayvens.es] INFO: Found listing with ID: 1981558
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981558%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [ayvens.es] INFO: Scrape type for 1981558: 1
2026-03-24 18:34:45 [ayvens.es] INFO: Extracting data for car ID: 1981558
2026-03-24 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ee19e0c-1008-5740-b80d-9a2793350bdb with identifier: 1981558
2026-03-24 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee19e0c-1008-5740-b80d-9a2793350bdb with scrape type 1
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ee19e0c-1008-5740-b80d-9a2793350bdb
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252Fcda6e81c502f4ad6be5839c089b9906f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/cda6e81c502f4ad6be5839c089b9906f/images/large/1.jpg not downloaded yet
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/537/a446d5f367b14c4d948c1fc88fdc3d03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/470/4603687768994d77bac27c81ebb4dd10/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:45 [ayvens.es] INFO: Found listing with ID: 1981559
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981559%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [ayvens.es] INFO: Scrape type for 1981559: 1
2026-03-24 18:34:45 [ayvens.es] INFO: Extracting data for car ID: 1981559
2026-03-24 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1981559
2026-03-24 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360cb534-6fe5-5577-ac9d-e99abc1d4446 with scrape type 1
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 360cb534-6fe5-5577-ac9d-e99abc1d4446
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252Fad8cabe4f2c941c1ac0fd60e128b018d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/ad8cabe4f2c941c1ac0fd60e128b018d/images/large/1.jpg not downloaded yet
2026-03-24 18:34:45 [ayvens.es] INFO: Found listing with ID: 1981560
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981560%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [ayvens.es] INFO: Scrape type for 1981560: 1
2026-03-24 18:34:45 [ayvens.es] INFO: Extracting data for car ID: 1981560
2026-03-24 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1981560
2026-03-24 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0d2231-b790-554e-84b9-b2d7d0ca8738 with scrape type 1
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb0d2231-b790-554e-84b9-b2d7d0ca8738
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252Fd259ff1874cf4e87b6282bb76503dc4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/d259ff1874cf4e87b6282bb76503dc4c/images/large/1.jpg not downloaded yet
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee218dd0>
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e6966f-01b1-55f0-8985-2351fa853a49/20e6966f-01b1-55f0-8985-2351fa853a49_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252Fb1fd2bf57f7a4dd29cfc63005cd37075%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/b1fd2bf57f7a4dd29cfc63005cd37075/images/large/1.jpg saved to cache
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20e6966f-01b1-55f0-8985-2351fa853a49
2026-03-24 18:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20e6966f-01b1-55f0-8985-2351fa853a49, skipping ID generation
2026-03-24 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e6966f-01b1-55f0-8985-2351fa853a49 with scrape type 1
2026-03-24 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20e6966f-01b1-55f0-8985-2351fa853a49 sending to next pipeline
2026-03-24 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 20e6966f-01b1-55f0-8985-2351fa853a49, identifier: 1981547
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee64b50>
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d62da4-d46c-548d-ba8f-c9e37cdc2dad/93d62da4-d46c-548d-ba8f-c9e37cdc2dad_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F932%252F598a0fd9f3944eb48066acd49ba3d2fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/932/598a0fd9f3944eb48066acd49ba3d2fa/images/large/1.jpg saved to cache
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93d62da4-d46c-548d-ba8f-c9e37cdc2dad
2026-03-24 18:34:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93d62da4-d46c-548d-ba8f-c9e37cdc2dad, skipping ID generation
2026-03-24 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d62da4-d46c-548d-ba8f-c9e37cdc2dad with scrape type 1
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93d62da4-d46c-548d-ba8f-c9e37cdc2dad sending to next pipeline
2026-03-24 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 93d62da4-d46c-548d-ba8f-c9e37cdc2dad, identifier: 1981548
2026-03-24 18:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9efcd0>
2026-03-24 18:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836a946-4ffe-522b-a673-5b60d4fbea3d/6836a946-4ffe-522b-a673-5b60d4fbea3d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fdca86280de084e7cb29b956f193f484e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/dca86280de084e7cb29b956f193f484e/images/large/1.jpg saved to cache
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6836a946-4ffe-522b-a673-5b60d4fbea3d
2026-03-24 18:34:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6836a946-4ffe-522b-a673-5b60d4fbea3d, skipping ID generation
2026-03-24 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6836a946-4ffe-522b-a673-5b60d4fbea3d with scrape type 1
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6836a946-4ffe-522b-a673-5b60d4fbea3d sending to next pipeline
2026-03-24 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6836a946-4ffe-522b-a673-5b60d4fbea3d, identifier: 1981543
2026-03-24 18:34:46 [ayvens.es] INFO: Found listing with ID: 1981561
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981561%27 HTTP/1.1" 200 None
2026-03-24 18:34:46 [ayvens.es] INFO: Scrape type for 1981561: 1
2026-03-24 18:34:46 [ayvens.es] INFO: Extracting data for car ID: 1981561
2026-03-24 18:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1981561
2026-03-24 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cd7f4e-d960-5524-8f7b-77200975a702 with scrape type 1
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9cd7f4e-d960-5524-8f7b-77200975a702
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F573eb87a10b9444681edc8809aef9541%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/573eb87a10b9444681edc8809aef9541/images/large/1.jpg not downloaded yet
2026-03-24 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1981547
2026-03-24 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1981547
2026-03-24 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1981547 to the API
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/047/b1fd2bf57f7a4dd29cfc63005cd37075/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '20e6966f-01b1-55f0-8985-2351fa853a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 106616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e6966f-01b1-55f0-8985-2351fa853a49/20e6966f-01b1-55f0-8985-2351fa853a49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/047/b1fd2bf57f7a4dd29cfc63005cd37075/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Active',
 'transmission': 'manual',
 'trim': '1.8 125H Active',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981547%27 HTTP/1.1" 200 None
2026-03-24 18:34:46 [ayvens.es] INFO: Saving data for 1981547: {'created_time': 1774377286.804915, 'last_price_update_time': 1774377286.804926, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981547') HTTP/1.1" 204 0
2026-03-24 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 93d62da4-d46c-548d-ba8f-c9e37cdc2dad with identifier: 1981548
2026-03-24 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 93d62da4-d46c-548d-ba8f-c9e37cdc2dad with identifier: 1981548
2026-03-24 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 93d62da4-d46c-548d-ba8f-c9e37cdc2dad with identifier: 1981548 to the API
2026-03-24 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/932/598a0fd9f3944eb48066acd49ba3d2fa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco nevada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '93d62da4-d46c-548d-ba8f-c9e37cdc2dad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 160052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d62da4-d46c-548d-ba8f-c9e37cdc2dad/93d62da4-d46c-548d-ba8f-c9e37cdc2dad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/932/598a0fd9f3944eb48066acd49ba3d2fa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981548%27 HTTP/1.1" 200 None
2026-03-24 18:34:47 [ayvens.es] INFO: Saving data for 1981548: {'created_time': 1774377287.147537, 'last_price_update_time': 1774377287.147547, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981548') HTTP/1.1" 204 0
2026-03-24 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6836a946-4ffe-522b-a673-5b60d4fbea3d with identifier: 1981543
2026-03-24 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6836a946-4ffe-522b-a673-5b60d4fbea3d with identifier: 1981543
2026-03-24 18:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6836a946-4ffe-522b-a673-5b60d4fbea3d with identifier: 1981543 to the API
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/567/dca86280de084e7cb29b956f193f484e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6836a946-4ffe-522b-a673-5b60d4fbea3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 109160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836a946-4ffe-522b-a673-5b60d4fbea3d/6836a946-4ffe-522b-a673-5b60d4fbea3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/dca86280de084e7cb29b956f193f484e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981543%27 HTTP/1.1" 200 None
2026-03-24 18:34:47 [ayvens.es] INFO: Saving data for 1981543: {'created_time': 1774377287.485533, 'last_price_update_time': 1774377287.485545, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981543') HTTP/1.1" 204 0
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9fbad0>
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca96feed-a9b2-5da4-898f-921fbbcf8558/ca96feed-a9b2-5da4-898f-921fbbcf8558_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252F24a117ffdf9f460789b8132b61c5942a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/24a117ffdf9f460789b8132b61c5942a/images/large/1.jpg saved to cache
2026-03-24 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca96feed-a9b2-5da4-898f-921fbbcf8558
2026-03-24 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca96feed-a9b2-5da4-898f-921fbbcf8558, skipping ID generation
2026-03-24 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca96feed-a9b2-5da4-898f-921fbbcf8558 with scrape type 1
2026-03-24 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca96feed-a9b2-5da4-898f-921fbbcf8558 sending to next pipeline
2026-03-24 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca96feed-a9b2-5da4-898f-921fbbcf8558, identifier: 1981549
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ef0c12d0>
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d1c9ce-9c7d-540d-825a-944cbf8315bf/a1d1c9ce-9c7d-540d-825a-944cbf8315bf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F989%252F8eb5165dd9ce4a8092dbf7ae6618fc0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/989/8eb5165dd9ce4a8092dbf7ae6618fc0f/images/large/1.jpg saved to cache
2026-03-24 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1d1c9ce-9c7d-540d-825a-944cbf8315bf
2026-03-24 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1d1c9ce-9c7d-540d-825a-944cbf8315bf, skipping ID generation
2026-03-24 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d1c9ce-9c7d-540d-825a-944cbf8315bf with scrape type 1
2026-03-24 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1d1c9ce-9c7d-540d-825a-944cbf8315bf sending to next pipeline
2026-03-24 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a1d1c9ce-9c7d-540d-825a-944cbf8315bf, identifier: 1981546
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9eef50>
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64232063-89a5-5458-b0e6-60745ca7ef15/64232063-89a5-5458-b0e6-60745ca7ef15_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252F3cdce5c9bdbf4dc5a4be7006193b8371%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/3cdce5c9bdbf4dc5a4be7006193b8371/images/large/1.jpg saved to cache
2026-03-24 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64232063-89a5-5458-b0e6-60745ca7ef15
2026-03-24 18:34:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64232063-89a5-5458-b0e6-60745ca7ef15, skipping ID generation
2026-03-24 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64232063-89a5-5458-b0e6-60745ca7ef15 with scrape type 1
2026-03-24 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64232063-89a5-5458-b0e6-60745ca7ef15 sending to next pipeline
2026-03-24 18:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 64232063-89a5-5458-b0e6-60745ca7ef15, identifier: 1981545
2026-03-24 18:34:48 [ayvens.es] INFO: Found listing with ID: 1981562
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981562%27 HTTP/1.1" 200 None
2026-03-24 18:34:48 [ayvens.es] INFO: Scrape type for 1981562: 1
2026-03-24 18:34:48 [ayvens.es] INFO: Extracting data for car ID: 1981562
2026-03-24 18:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1981562
2026-03-24 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69230fc6-af24-58d7-9d61-0d90c7533d5c with scrape type 1
2026-03-24 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69230fc6-af24-58d7-9d61-0d90c7533d5c
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252F6a96ce2c9f114e6c91597eb8830fa28e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/6a96ce2c9f114e6c91597eb8830fa28e/images/large/1.jpg not downloaded yet
2026-03-24 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1981549
2026-03-24 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1981549
2026-03-24 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1981549 to the API
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/667/24a117ffdf9f460789b8132b61c5942a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Azul atl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ca96feed-a9b2-5da4-898f-921fbbcf8558',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 126971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca96feed-a9b2-5da4-898f-921fbbcf8558/ca96feed-a9b2-5da4-898f-921fbbcf8558_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/667/24a117ffdf9f460789b8132b61c5942a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981549%27 HTTP/1.1" 200 None
2026-03-24 18:34:48 [ayvens.es] INFO: Saving data for 1981549: {'created_time': 1774377288.445609, 'last_price_update_time': 1774377288.445619, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981549') HTTP/1.1" 204 0
2026-03-24 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a1d1c9ce-9c7d-540d-825a-944cbf8315bf with identifier: 1981546
2026-03-24 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a1d1c9ce-9c7d-540d-825a-944cbf8315bf with identifier: 1981546
2026-03-24 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a1d1c9ce-9c7d-540d-825a-944cbf8315bf with identifier: 1981546 to the API
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/989/8eb5165dd9ce4a8092dbf7ae6618fc0f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco nevada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a1d1c9ce-9c7d-540d-825a-944cbf8315bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 157949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d1c9ce-9c7d-540d-825a-944cbf8315bf/a1d1c9ce-9c7d-540d-825a-944cbf8315bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/989/8eb5165dd9ce4a8092dbf7ae6618fc0f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981546%27 HTTP/1.1" 200 None
2026-03-24 18:34:48 [ayvens.es] INFO: Saving data for 1981546: {'created_time': 1774377288.776981, 'last_price_update_time': 1774377288.776994, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981546') HTTP/1.1" 204 0
2026-03-24 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1981545
2026-03-24 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1981545
2026-03-24 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1981545 to the API
2026-03-24 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/068/3cdce5c9bdbf4dc5a4be7006193b8371/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '64232063-89a5-5458-b0e6-60745ca7ef15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 86713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64232063-89a5-5458-b0e6-60745ca7ef15/64232063-89a5-5458-b0e6-60745ca7ef15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/068/3cdce5c9bdbf4dc5a4be7006193b8371/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981545%27 HTTP/1.1" 200 None
2026-03-24 18:34:49 [ayvens.es] INFO: Saving data for 1981545: {'created_time': 1774377289.11272, 'last_price_update_time': 1774377289.112731, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981545') HTTP/1.1" 204 0
2026-03-24 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/188/b1053f0e873b40ef86f20cc045340540/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eea324d0>
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ffa0749-95da-59b2-8101-a9dba8b9ddab/1ffa0749-95da-59b2-8101-a9dba8b9ddab_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252Fa446d5f367b14c4d948c1fc88fdc3d03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/a446d5f367b14c4d948c1fc88fdc3d03/images/large/1.jpg saved to cache
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ffa0749-95da-59b2-8101-a9dba8b9ddab
2026-03-24 18:34:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ffa0749-95da-59b2-8101-a9dba8b9ddab, skipping ID generation
2026-03-24 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ffa0749-95da-59b2-8101-a9dba8b9ddab with scrape type 1
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ffa0749-95da-59b2-8101-a9dba8b9ddab sending to next pipeline
2026-03-24 18:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1ffa0749-95da-59b2-8101-a9dba8b9ddab, identifier: 1981544
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee873390>
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327a1ae7-6b70-5007-9cb8-8d43972fd96b/327a1ae7-6b70-5007-9cb8-8d43972fd96b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F470%252F4603687768994d77bac27c81ebb4dd10%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/470/4603687768994d77bac27c81ebb4dd10/images/large/1.jpg saved to cache
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b
2026-03-24 18:34:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 327a1ae7-6b70-5007-9cb8-8d43972fd96b, skipping ID generation
2026-03-24 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b with scrape type 1
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b sending to next pipeline
2026-03-24 18:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 327a1ae7-6b70-5007-9cb8-8d43972fd96b, identifier: 1981550
2026-03-24 18:34:49 [ayvens.es] INFO: Found listing with ID: 1981563
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981563%27 HTTP/1.1" 200 None
2026-03-24 18:34:49 [ayvens.es] INFO: Scrape type for 1981563: 1
2026-03-24 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1981563
2026-03-24 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1981563
2026-03-24 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f8d5e7-4fea-5628-b79f-193dad0799fa with scrape type 1
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23f8d5e7-4fea-5628-b79f-193dad0799fa
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F832%252F98c2268227294ce0b8632d820cc36b54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/832/98c2268227294ce0b8632d820cc36b54/images/large/1.jpg not downloaded yet
2026-03-24 18:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1ffa0749-95da-59b2-8101-a9dba8b9ddab with identifier: 1981544
2026-03-24 18:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1ffa0749-95da-59b2-8101-a9dba8b9ddab with identifier: 1981544
2026-03-24 18:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1ffa0749-95da-59b2-8101-a9dba8b9ddab with identifier: 1981544 to the API
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/537/a446d5f367b14c4d948c1fc88fdc3d03/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1ffa0749-95da-59b2-8101-a9dba8b9ddab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 105665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ffa0749-95da-59b2-8101-a9dba8b9ddab/1ffa0749-95da-59b2-8101-a9dba8b9ddab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/537/a446d5f367b14c4d948c1fc88fdc3d03/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': '(O) Business Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981544%27 HTTP/1.1" 200 None
2026-03-24 18:34:49 [ayvens.es] INFO: Saving data for 1981544: {'created_time': 1774377289.779309, 'last_price_update_time': 1774377289.77932, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981544') HTTP/1.1" 204 0
2026-03-24 18:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1981550
2026-03-24 18:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1981550
2026-03-24 18:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1981550 to the API
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/470/4603687768994d77bac27c81ebb4dd10/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '327a1ae7-6b70-5007-9cb8-8d43972fd96b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 50429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327a1ae7-6b70-5007-9cb8-8d43972fd96b/327a1ae7-6b70-5007-9cb8-8d43972fd96b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/470/4603687768994d77bac27c81ebb4dd10/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981550%27 HTTP/1.1" 200 None
2026-03-24 18:34:50 [ayvens.es] INFO: Saving data for 1981550: {'created_time': 1774377290.070987, 'last_price_update_time': 1774377290.071001, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981550') HTTP/1.1" 204 0
2026-03-24 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/240/decc5d74150144dba92280d6e4bca87a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/865/babbe578a30c4344b7ed59b835732e4a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/871/01723d368c1a4a8caef2d8c832c21837/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/203/117582df99b144e78adf2401a48930f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/175/67312f4d2ba640a9819aa811a80f904e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:50 [ayvens.es] INFO: Found listing with ID: 1981564
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981564%27 HTTP/1.1" 200 None
2026-03-24 18:34:50 [ayvens.es] INFO: Scrape type for 1981564: 1
2026-03-24 18:34:50 [ayvens.es] INFO: Extracting data for car ID: 1981564
2026-03-24 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1981564
2026-03-24 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with scrape type 1
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F998b3502584140e3b55bbc70eb4c4ffe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/998b3502584140e3b55bbc70eb4c4ffe/images/large/1.jpg not downloaded yet
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91fd986a50>
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_832a6a52-5d95-5ef2-8dfa-da2f06b8141f/832a6a52-5d95-5ef2-8dfa-da2f06b8141f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252Fb1053f0e873b40ef86f20cc045340540%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/b1053f0e873b40ef86f20cc045340540/images/large/1.jpg saved to cache
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f
2026-03-24 18:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f, skipping ID generation
2026-03-24 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with scrape type 1
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f sending to next pipeline
2026-03-24 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f, identifier: 1981554
2026-03-24 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/466/a19a45aab7c847dcb8f9f45579983a39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1981554
2026-03-24 18:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1981554
2026-03-24 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1981554 to the API
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/188/b1053f0e873b40ef86f20cc045340540/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Azul makro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '832a6a52-5d95-5ef2-8dfa-da2f06b8141f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 101159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_832a6a52-5d95-5ef2-8dfa-da2f06b8141f/832a6a52-5d95-5ef2-8dfa-da2f06b8141f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/188/b1053f0e873b40ef86f20cc045340540/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2018}
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981554%27 HTTP/1.1" 200 None
2026-03-24 18:34:50 [ayvens.es] INFO: Saving data for 1981554: {'created_time': 1774377290.627434, 'last_price_update_time': 1774377290.627444, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981554') HTTP/1.1" 204 0
2026-03-24 18:34:50 [ayvens.es] INFO: Found listing with ID: 1981565
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981565%27 HTTP/1.1" 200 None
2026-03-24 18:34:50 [ayvens.es] INFO: Scrape type for 1981565: 1
2026-03-24 18:34:50 [ayvens.es] INFO: Extracting data for car ID: 1981565
2026-03-24 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1981565
2026-03-24 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with scrape type 1
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F212%252F6e5a0b3a1d3149f9b5365eda7e3431a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/212/6e5a0b3a1d3149f9b5365eda7e3431a9/images/large/1.jpg not downloaded yet
2026-03-24 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/406/cda6e81c502f4ad6be5839c089b9906f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7bb590>
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1484a54-6b3a-575e-b277-4a549ffeecaf/c1484a54-6b3a-575e-b277-4a549ffeecaf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fdecc5d74150144dba92280d6e4bca87a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/decc5d74150144dba92280d6e4bca87a/images/large/1.jpg saved to cache
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1484a54-6b3a-575e-b277-4a549ffeecaf
2026-03-24 18:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1484a54-6b3a-575e-b277-4a549ffeecaf, skipping ID generation
2026-03-24 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1484a54-6b3a-575e-b277-4a549ffeecaf with scrape type 1
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1484a54-6b3a-575e-b277-4a549ffeecaf sending to next pipeline
2026-03-24 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c1484a54-6b3a-575e-b277-4a549ffeecaf, identifier: 1981551
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6e3a90>
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2452118-a699-595a-a9c9-afbf9c6e6419/d2452118-a699-595a-a9c9-afbf9c6e6419_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252Fbabbe578a30c4344b7ed59b835732e4a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/babbe578a30c4344b7ed59b835732e4a/images/large/1.jpg saved to cache
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2452118-a699-595a-a9c9-afbf9c6e6419
2026-03-24 18:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2452118-a699-595a-a9c9-afbf9c6e6419, skipping ID generation
2026-03-24 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2452118-a699-595a-a9c9-afbf9c6e6419 with scrape type 1
2026-03-24 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2452118-a699-595a-a9c9-afbf9c6e6419 sending to next pipeline
2026-03-24 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d2452118-a699-595a-a9c9-afbf9c6e6419, identifier: 1981553
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee389d0>
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd463c99-308b-5fcd-9d1f-599eb1f6335e/dd463c99-308b-5fcd-9d1f-599eb1f6335e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F01723d368c1a4a8caef2d8c832c21837%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/01723d368c1a4a8caef2d8c832c21837/images/large/1.jpg saved to cache
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd463c99-308b-5fcd-9d1f-599eb1f6335e
2026-03-24 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd463c99-308b-5fcd-9d1f-599eb1f6335e, skipping ID generation
2026-03-24 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd463c99-308b-5fcd-9d1f-599eb1f6335e with scrape type 1
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd463c99-308b-5fcd-9d1f-599eb1f6335e sending to next pipeline
2026-03-24 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dd463c99-308b-5fcd-9d1f-599eb1f6335e, identifier: 1981552
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee8d3c10>
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813aa247-ff33-53b0-92f7-74751a918d74/813aa247-ff33-53b0-92f7-74751a918d74_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F203%252F117582df99b144e78adf2401a48930f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/203/117582df99b144e78adf2401a48930f6/images/large/1.jpg saved to cache
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 813aa247-ff33-53b0-92f7-74751a918d74
2026-03-24 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 813aa247-ff33-53b0-92f7-74751a918d74, skipping ID generation
2026-03-24 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 813aa247-ff33-53b0-92f7-74751a918d74 with scrape type 1
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 813aa247-ff33-53b0-92f7-74751a918d74 sending to next pipeline
2026-03-24 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 813aa247-ff33-53b0-92f7-74751a918d74, identifier: 1981557
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee247010>
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356b6385-5c14-5168-8787-25febf5f7989/356b6385-5c14-5168-8787-25febf5f7989_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252F67312f4d2ba640a9819aa811a80f904e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/67312f4d2ba640a9819aa811a80f904e/images/large/1.jpg saved to cache
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 356b6385-5c14-5168-8787-25febf5f7989
2026-03-24 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 356b6385-5c14-5168-8787-25febf5f7989, skipping ID generation
2026-03-24 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356b6385-5c14-5168-8787-25febf5f7989 with scrape type 1
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 356b6385-5c14-5168-8787-25febf5f7989 sending to next pipeline
2026-03-24 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 356b6385-5c14-5168-8787-25febf5f7989, identifier: 1981555
2026-03-24 18:34:51 [ayvens.es] INFO: Found listing with ID: 1981566
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981566%27 HTTP/1.1" 200 None
2026-03-24 18:34:51 [ayvens.es] INFO: Scrape type for 1981566: 1
2026-03-24 18:34:51 [ayvens.es] INFO: Extracting data for car ID: 1981566
2026-03-24 18:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1981566
2026-03-24 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with scrape type 1
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F929%252F599394764f0c4ce7b4e2ff3f14ee1216%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/929/599394764f0c4ce7b4e2ff3f14ee1216/images/large/1.jpg not downloaded yet
2026-03-24 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1981551
2026-03-24 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1981551
2026-03-24 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1981551 to the API
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/240/decc5d74150144dba92280d6e4bca87a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c1484a54-6b3a-575e-b277-4a549ffeecaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 169230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1484a54-6b3a-575e-b277-4a549ffeecaf/c1484a54-6b3a-575e-b277-4a549ffeecaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/240/decc5d74150144dba92280d6e4bca87a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981551%27 HTTP/1.1" 200 None
2026-03-24 18:34:51 [ayvens.es] INFO: Saving data for 1981551: {'created_time': 1774377291.829822, 'last_price_update_time': 1774377291.829832, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981551') HTTP/1.1" 204 0
2026-03-24 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1981553
2026-03-24 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1981553
2026-03-24 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1981553 to the API
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/865/babbe578a30c4344b7ed59b835732e4a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd2452118-a699-595a-a9c9-afbf9c6e6419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 80408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2452118-a699-595a-a9c9-afbf9c6e6419/d2452118-a699-595a-a9c9-afbf9c6e6419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/865/babbe578a30c4344b7ed59b835732e4a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981553%27 HTTP/1.1" 200 None
2026-03-24 18:34:52 [ayvens.es] INFO: Saving data for 1981553: {'created_time': 1774377292.238811, 'last_price_update_time': 1774377292.238823, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981553') HTTP/1.1" 204 0
2026-03-24 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dd463c99-308b-5fcd-9d1f-599eb1f6335e with identifier: 1981552
2026-03-24 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dd463c99-308b-5fcd-9d1f-599eb1f6335e with identifier: 1981552
2026-03-24 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dd463c99-308b-5fcd-9d1f-599eb1f6335e with identifier: 1981552 to the API
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/871/01723d368c1a4a8caef2d8c832c21837/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Negro cosmo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'dd463c99-308b-5fcd-9d1f-599eb1f6335e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 96274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd463c99-308b-5fcd-9d1f-599eb1f6335e/dd463c99-308b-5fcd-9d1f-599eb1f6335e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/871/01723d368c1a4a8caef2d8c832c21837/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Black Edition 4WD',
 'transmission': 'manual',
 'trim': '2.5l 220H Black Edition 4WD',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981552%27 HTTP/1.1" 200 None
2026-03-24 18:34:52 [ayvens.es] INFO: Saving data for 1981552: {'created_time': 1774377292.595045, 'last_price_update_time': 1774377292.595056, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981552') HTTP/1.1" 204 0
2026-03-24 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 813aa247-ff33-53b0-92f7-74751a918d74 with identifier: 1981557
2026-03-24 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 813aa247-ff33-53b0-92f7-74751a918d74 with identifier: 1981557
2026-03-24 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 813aa247-ff33-53b0-92f7-74751a918d74 with identifier: 1981557 to the API
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/203/117582df99b144e78adf2401a48930f6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '813aa247-ff33-53b0-92f7-74751a918d74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 59991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813aa247-ff33-53b0-92f7-74751a918d74/813aa247-ff33-53b0-92f7-74751a918d74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/203/117582df99b144e78adf2401a48930f6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981557%27 HTTP/1.1" 200 None
2026-03-24 18:34:52 [ayvens.es] INFO: Saving data for 1981557: {'created_time': 1774377292.935982, 'last_price_update_time': 1774377292.935992, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981557') HTTP/1.1" 204 0
2026-03-24 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1981555
2026-03-24 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1981555
2026-03-24 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1981555 to the API
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/175/67312f4d2ba640a9819aa811a80f904e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '356b6385-5c14-5168-8787-25febf5f7989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 77276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356b6385-5c14-5168-8787-25febf5f7989/356b6385-5c14-5168-8787-25febf5f7989_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/175/67312f4d2ba640a9819aa811a80f904e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981555%27 HTTP/1.1" 200 None
2026-03-24 18:34:53 [ayvens.es] INFO: Saving data for 1981555: {'created_time': 1774377293.264332, 'last_price_update_time': 1774377293.264346, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981555') HTTP/1.1" 204 0
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eee65050>
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_116b50bf-76c6-5f3c-b8d2-1a813a621f70/116b50bf-76c6-5f3c-b8d2-1a813a621f70_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fa19a45aab7c847dcb8f9f45579983a39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/a19a45aab7c847dcb8f9f45579983a39/images/large/1.jpg saved to cache
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 116b50bf-76c6-5f3c-b8d2-1a813a621f70
2026-03-24 18:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 116b50bf-76c6-5f3c-b8d2-1a813a621f70, skipping ID generation
2026-03-24 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 116b50bf-76c6-5f3c-b8d2-1a813a621f70 with scrape type 1
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 116b50bf-76c6-5f3c-b8d2-1a813a621f70 sending to next pipeline
2026-03-24 18:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 116b50bf-76c6-5f3c-b8d2-1a813a621f70, identifier: 1981556
2026-03-24 18:34:53 [ayvens.es] INFO: Found listing with ID: 1981567
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981567%27 HTTP/1.1" 200 None
2026-03-24 18:34:53 [ayvens.es] INFO: Scrape type for 1981567: 1
2026-03-24 18:34:53 [ayvens.es] INFO: Extracting data for car ID: 1981567
2026-03-24 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f10af1-4933-564c-8a84-2026967307aa with identifier: 1981567
2026-03-24 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f10af1-4933-564c-8a84-2026967307aa with scrape type 1
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21f10af1-4933-564c-8a84-2026967307aa
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F407%252Fdcaa187c884d4c94a4e6969c107bd2d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/407/dcaa187c884d4c94a4e6969c107bd2d5/images/large/1.jpg not downloaded yet
2026-03-24 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 116b50bf-76c6-5f3c-b8d2-1a813a621f70 with identifier: 1981556
2026-03-24 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 116b50bf-76c6-5f3c-b8d2-1a813a621f70 with identifier: 1981556
2026-03-24 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 116b50bf-76c6-5f3c-b8d2-1a813a621f70 with identifier: 1981556 to the API
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/466/a19a45aab7c847dcb8f9f45579983a39/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Negro azabache',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '116b50bf-76c6-5f3c-b8d2-1a813a621f70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 73450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116b50bf-76c6-5f3c-b8d2-1a813a621f70/116b50bf-76c6-5f3c-b8d2-1a813a621f70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/466/a19a45aab7c847dcb8f9f45579983a39/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981556%27 HTTP/1.1" 200 None
2026-03-24 18:34:53 [ayvens.es] INFO: Saving data for 1981556: {'created_time': 1774377293.826894, 'last_price_update_time': 1774377293.826906, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981556') HTTP/1.1" 204 0
2026-03-24 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/129/ad8cabe4f2c941c1ac0fd60e128b018d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7fd690>
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ee19e0c-1008-5740-b80d-9a2793350bdb/4ee19e0c-1008-5740-b80d-9a2793350bdb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252Fcda6e81c502f4ad6be5839c089b9906f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/cda6e81c502f4ad6be5839c089b9906f/images/large/1.jpg saved to cache
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ee19e0c-1008-5740-b80d-9a2793350bdb
2026-03-24 18:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ee19e0c-1008-5740-b80d-9a2793350bdb, skipping ID generation
2026-03-24 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee19e0c-1008-5740-b80d-9a2793350bdb with scrape type 1
2026-03-24 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ee19e0c-1008-5740-b80d-9a2793350bdb sending to next pipeline
2026-03-24 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ee19e0c-1008-5740-b80d-9a2793350bdb, identifier: 1981558
2026-03-24 18:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/646/d259ff1874cf4e87b6282bb76503dc4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:54 [ayvens.es] INFO: Found listing with ID: 1981568
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981568%27 HTTP/1.1" 200 None
2026-03-24 18:34:54 [ayvens.es] INFO: Scrape type for 1981568: 1
2026-03-24 18:34:54 [ayvens.es] INFO: Extracting data for car ID: 1981568
2026-03-24 18:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69695edd-2a3c-517b-89a3-672a1297c69e with identifier: 1981568
2026-03-24 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69695edd-2a3c-517b-89a3-672a1297c69e with scrape type 1
2026-03-24 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69695edd-2a3c-517b-89a3-672a1297c69e
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F501%252Fca3bd311bf8a4cb890a6aa079dc680ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/501/ca3bd311bf8a4cb890a6aa079dc680ad/images/large/1.jpg not downloaded yet
2026-03-24 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ee19e0c-1008-5740-b80d-9a2793350bdb with identifier: 1981558
2026-03-24 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ee19e0c-1008-5740-b80d-9a2793350bdb with identifier: 1981558
2026-03-24 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ee19e0c-1008-5740-b80d-9a2793350bdb with identifier: 1981558 to the API
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/406/cda6e81c502f4ad6be5839c089b9906f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ee19e0c-1008-5740-b80d-9a2793350bdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 94541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ee19e0c-1008-5740-b80d-9a2793350bdb/4ee19e0c-1008-5740-b80d-9a2793350bdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/406/cda6e81c502f4ad6be5839c089b9906f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981558%27 HTTP/1.1" 200 None
2026-03-24 18:34:54 [ayvens.es] INFO: Saving data for 1981558: {'created_time': 1774377294.414502, 'last_price_update_time': 1774377294.414513, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981558') HTTP/1.1" 204 0
2026-03-24 18:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/018/6a96ce2c9f114e6c91597eb8830fa28e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/832/98c2268227294ce0b8632d820cc36b54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:54 [ayvens.es] INFO: Found listing with ID: 1981569
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981569%27 HTTP/1.1" 200 None
2026-03-24 18:34:54 [ayvens.es] INFO: Scrape type for 1981569: 1
2026-03-24 18:34:54 [ayvens.es] INFO: Extracting data for car ID: 1981569
2026-03-24 18:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c with identifier: 1981569
2026-03-24 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c with scrape type 1
2026-03-24 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F926%252Fe66c558f7ba148d3a05619c613597388%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/926/e66c558f7ba148d3a05619c613597388/images/large/1.jpg not downloaded yet
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1d5d50>
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360cb534-6fe5-5577-ac9d-e99abc1d4446/360cb534-6fe5-5577-ac9d-e99abc1d4446_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252Fad8cabe4f2c941c1ac0fd60e128b018d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/ad8cabe4f2c941c1ac0fd60e128b018d/images/large/1.jpg saved to cache
2026-03-24 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 360cb534-6fe5-5577-ac9d-e99abc1d4446
2026-03-24 18:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 360cb534-6fe5-5577-ac9d-e99abc1d4446, skipping ID generation
2026-03-24 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360cb534-6fe5-5577-ac9d-e99abc1d4446 with scrape type 1
2026-03-24 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 360cb534-6fe5-5577-ac9d-e99abc1d4446 sending to next pipeline
2026-03-24 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 360cb534-6fe5-5577-ac9d-e99abc1d4446, identifier: 1981559
2026-03-24 18:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/279/573eb87a10b9444681edc8809aef9541/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1981559
2026-03-24 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1981559
2026-03-24 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1981559 to the API
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/129/ad8cabe4f2c941c1ac0fd60e128b018d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '360cb534-6fe5-5577-ac9d-e99abc1d4446',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 93155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360cb534-6fe5-5577-ac9d-e99abc1d4446/360cb534-6fe5-5577-ac9d-e99abc1d4446_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/129/ad8cabe4f2c941c1ac0fd60e128b018d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 110kW S&S Xcellence',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981559%27 HTTP/1.1" 200 None
2026-03-24 18:34:54 [ayvens.es] INFO: Saving data for 1981559: {'created_time': 1774377294.9465, 'last_price_update_time': 1774377294.94651, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981559') HTTP/1.1" 204 0
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7c5a10>
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0d2231-b790-554e-84b9-b2d7d0ca8738/eb0d2231-b790-554e-84b9-b2d7d0ca8738_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252Fd259ff1874cf4e87b6282bb76503dc4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/d259ff1874cf4e87b6282bb76503dc4c/images/large/1.jpg saved to cache
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb0d2231-b790-554e-84b9-b2d7d0ca8738
2026-03-24 18:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb0d2231-b790-554e-84b9-b2d7d0ca8738, skipping ID generation
2026-03-24 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0d2231-b790-554e-84b9-b2d7d0ca8738 with scrape type 1
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb0d2231-b790-554e-84b9-b2d7d0ca8738 sending to next pipeline
2026-03-24 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb0d2231-b790-554e-84b9-b2d7d0ca8738, identifier: 1981560
2026-03-24 18:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/629/998b3502584140e3b55bbc70eb4c4ffe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:55 [ayvens.es] INFO: Found listing with ID: 1981570
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981570%27 HTTP/1.1" 200 None
2026-03-24 18:34:55 [ayvens.es] INFO: Scrape type for 1981570: 1
2026-03-24 18:34:55 [ayvens.es] INFO: Extracting data for car ID: 1981570
2026-03-24 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1981570
2026-03-24 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd with scrape type 1
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252F8f622fbb8d8a44ed84802d1647335620%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/8f622fbb8d8a44ed84802d1647335620/images/large/1.jpg not downloaded yet
2026-03-24 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1981560
2026-03-24 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1981560
2026-03-24 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1981560 to the API
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/646/d259ff1874cf4e87b6282bb76503dc4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Plata tungsteno',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eb0d2231-b790-554e-84b9-b2d7d0ca8738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 152582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0d2231-b790-554e-84b9-b2d7d0ca8738/eb0d2231-b790-554e-84b9-b2d7d0ca8738_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/646/d259ff1874cf4e87b6282bb76503dc4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Sport 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Sport 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981560%27 HTTP/1.1" 200 None
2026-03-24 18:34:55 [ayvens.es] INFO: Saving data for 1981560: {'created_time': 1774377295.470876, 'last_price_update_time': 1774377295.470887, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981560') HTTP/1.1" 204 0
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9c06d0>
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69230fc6-af24-58d7-9d61-0d90c7533d5c/69230fc6-af24-58d7-9d61-0d90c7533d5c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252F6a96ce2c9f114e6c91597eb8830fa28e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/6a96ce2c9f114e6c91597eb8830fa28e/images/large/1.jpg saved to cache
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69230fc6-af24-58d7-9d61-0d90c7533d5c
2026-03-24 18:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69230fc6-af24-58d7-9d61-0d90c7533d5c, skipping ID generation
2026-03-24 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69230fc6-af24-58d7-9d61-0d90c7533d5c with scrape type 1
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69230fc6-af24-58d7-9d61-0d90c7533d5c sending to next pipeline
2026-03-24 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69230fc6-af24-58d7-9d61-0d90c7533d5c, identifier: 1981562
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eef5f210>
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f8d5e7-4fea-5628-b79f-193dad0799fa/23f8d5e7-4fea-5628-b79f-193dad0799fa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F832%252F98c2268227294ce0b8632d820cc36b54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/832/98c2268227294ce0b8632d820cc36b54/images/large/1.jpg saved to cache
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23f8d5e7-4fea-5628-b79f-193dad0799fa
2026-03-24 18:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23f8d5e7-4fea-5628-b79f-193dad0799fa, skipping ID generation
2026-03-24 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f8d5e7-4fea-5628-b79f-193dad0799fa with scrape type 1
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23f8d5e7-4fea-5628-b79f-193dad0799fa sending to next pipeline
2026-03-24 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23f8d5e7-4fea-5628-b79f-193dad0799fa, identifier: 1981563
2026-03-24 18:34:55 [ayvens.es] INFO: Found listing with ID: 1981571
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981571%27 HTTP/1.1" 200 None
2026-03-24 18:34:55 [ayvens.es] INFO: Scrape type for 1981571: 1
2026-03-24 18:34:55 [ayvens.es] INFO: Extracting data for car ID: 1981571
2026-03-24 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a291efa0-a328-5d44-bd5f-8cb0293a7daf with identifier: 1981571
2026-03-24 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a291efa0-a328-5d44-bd5f-8cb0293a7daf with scrape type 1
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a291efa0-a328-5d44-bd5f-8cb0293a7daf
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252F68f493e8c49a4e149747efd302758e83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/68f493e8c49a4e149747efd302758e83/images/large/1.jpg not downloaded yet
2026-03-24 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1981562
2026-03-24 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1981562
2026-03-24 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1981562 to the API
2026-03-24 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/018/6a96ce2c9f114e6c91597eb8830fa28e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco nevada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '69230fc6-af24-58d7-9d61-0d90c7533d5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 83216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69230fc6-af24-58d7-9d61-0d90c7533d5c/69230fc6-af24-58d7-9d61-0d90c7533d5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/018/6a96ce2c9f114e6c91597eb8830fa28e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 EcoTSI 70kW (95CV) Style Plus',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI 70kW (95CV) Style Plus',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981562%27 HTTP/1.1" 200 None
2026-03-24 18:34:56 [ayvens.es] INFO: Saving data for 1981562: {'created_time': 1774377296.184579, 'last_price_update_time': 1774377296.184591, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981562') HTTP/1.1" 204 0
2026-03-24 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1981563
2026-03-24 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1981563
2026-03-24 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1981563 to the API
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/832/98c2268227294ce0b8632d820cc36b54/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '23f8d5e7-4fea-5628-b79f-193dad0799fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 125791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f8d5e7-4fea-5628-b79f-193dad0799fa/23f8d5e7-4fea-5628-b79f-193dad0799fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/832/98c2268227294ce0b8632d820cc36b54/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Energy dCi 110',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 110',
 'vin': None,
 'year': 2017}
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981563%27 HTTP/1.1" 200 None
2026-03-24 18:34:56 [ayvens.es] INFO: Saving data for 1981563: {'created_time': 1774377296.528504, 'last_price_update_time': 1774377296.528515, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981563') HTTP/1.1" 204 0
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7c41d0>
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9cd7f4e-d960-5524-8f7b-77200975a702/c9cd7f4e-d960-5524-8f7b-77200975a702_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F573eb87a10b9444681edc8809aef9541%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/573eb87a10b9444681edc8809aef9541/images/large/1.jpg saved to cache
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9cd7f4e-d960-5524-8f7b-77200975a702
2026-03-24 18:34:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9cd7f4e-d960-5524-8f7b-77200975a702, skipping ID generation
2026-03-24 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cd7f4e-d960-5524-8f7b-77200975a702 with scrape type 1
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9cd7f4e-d960-5524-8f7b-77200975a702 sending to next pipeline
2026-03-24 18:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9cd7f4e-d960-5524-8f7b-77200975a702, identifier: 1981561
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee6e1c50>
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbf9c12-b252-5132-aafa-3e3fd1f09825/8bbf9c12-b252-5132-aafa-3e3fd1f09825_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F998b3502584140e3b55bbc70eb4c4ffe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/998b3502584140e3b55bbc70eb4c4ffe/images/large/1.jpg saved to cache
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825
2026-03-24 18:34:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bbf9c12-b252-5132-aafa-3e3fd1f09825, skipping ID generation
2026-03-24 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with scrape type 1
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825 sending to next pipeline
2026-03-24 18:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8bbf9c12-b252-5132-aafa-3e3fd1f09825, identifier: 1981564
2026-03-24 18:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/212/6e5a0b3a1d3149f9b5365eda7e3431a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:56 [ayvens.es] INFO: Found listing with ID: 1981572
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981572%27 HTTP/1.1" 200 None
2026-03-24 18:34:56 [ayvens.es] INFO: Scrape type for 1981572: 1
2026-03-24 18:34:56 [ayvens.es] INFO: Extracting data for car ID: 1981572
2026-03-24 18:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1981572
2026-03-24 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with scrape type 1
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F584%252F751fb686f8a84ab283a52c1d30657a59%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/584/751fb686f8a84ab283a52c1d30657a59/images/large/1.jpg not downloaded yet
2026-03-24 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1981561
2026-03-24 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1981561
2026-03-24 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1981561 to the API
2026-03-24 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/279/573eb87a10b9444681edc8809aef9541/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9cd7f4e-d960-5524-8f7b-77200975a702',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 62538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9cd7f4e-d960-5524-8f7b-77200975a702/c9cd7f4e-d960-5524-8f7b-77200975a702_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/279/573eb87a10b9444681edc8809aef9541/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981561%27 HTTP/1.1" 200 None
2026-03-24 18:34:57 [ayvens.es] INFO: Saving data for 1981561: {'created_time': 1774377297.203704, 'last_price_update_time': 1774377297.203717, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981561') HTTP/1.1" 204 0
2026-03-24 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1981564
2026-03-24 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1981564
2026-03-24 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1981564 to the API
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/629/998b3502584140e3b55bbc70eb4c4ffe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Plata metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8bbf9c12-b252-5132-aafa-3e3fd1f09825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 128374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbf9c12-b252-5132-aafa-3e3fd1f09825/8bbf9c12-b252-5132-aafa-3e3fd1f09825_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/629/998b3502584140e3b55bbc70eb4c4ffe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D AWD Business Plus Auto',
 'transmission': 'manual',
 'trim': '2.0 B4 D AWD Business Plus Auto',
 'vin': None,
 'year': 2019}
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981564%27 HTTP/1.1" 200 None
2026-03-24 18:34:57 [ayvens.es] INFO: Saving data for 1981564: {'created_time': 1774377297.548393, 'last_price_update_time': 1774377297.548403, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981564') HTTP/1.1" 204 0
2026-03-24 18:34:57 [ayvens.es] INFO: Found listing with ID: 1981573
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981573%27 HTTP/1.1" 200 None
2026-03-24 18:34:57 [ayvens.es] INFO: Scrape type for 1981573: 1
2026-03-24 18:34:57 [ayvens.es] INFO: Extracting data for car ID: 1981573
2026-03-24 18:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84032d6d-278f-5e60-91c1-eda367930657 with identifier: 1981573
2026-03-24 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84032d6d-278f-5e60-91c1-eda367930657 with scrape type 1
2026-03-24 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84032d6d-278f-5e60-91c1-eda367930657
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F182%252F395e78a2a6bc48308a5c62b9ab5411fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/182/395e78a2a6bc48308a5c62b9ab5411fd/images/large/1.jpg not downloaded yet
2026-03-24 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/407/dcaa187c884d4c94a4e6969c107bd2d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/501/ca3bd311bf8a4cb890a6aa079dc680ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eed49510>
2026-03-24 18:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b09c77f0-b246-58a1-bd7c-e14d7272a1f1/b09c77f0-b246-58a1-bd7c-e14d7272a1f1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F212%252F6e5a0b3a1d3149f9b5365eda7e3431a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/212/6e5a0b3a1d3149f9b5365eda7e3431a9/images/large/1.jpg saved to cache
2026-03-24 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1
2026-03-24 18:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b09c77f0-b246-58a1-bd7c-e14d7272a1f1, skipping ID generation
2026-03-24 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with scrape type 1
2026-03-24 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1 sending to next pipeline
2026-03-24 18:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b09c77f0-b246-58a1-bd7c-e14d7272a1f1, identifier: 1981565
2026-03-24 18:34:57 [ayvens.es] INFO: Found listing with ID: 1981574
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981574%27 HTTP/1.1" 200 None
2026-03-24 18:34:57 [ayvens.es] INFO: Scrape type for 1981574: 1
2026-03-24 18:34:57 [ayvens.es] INFO: Extracting data for car ID: 1981574
2026-03-24 18:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0 with identifier: 1981574
2026-03-24 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0 with scrape type 1
2026-03-24 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F612%252Fa88489ae0e264cc291fd51a1286ea9cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/612/a88489ae0e264cc291fd51a1286ea9cd/images/large/1.jpg not downloaded yet
2026-03-24 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1981565
2026-03-24 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1981565
2026-03-24 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1981565 to the API
2026-03-24 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/212/6e5a0b3a1d3149f9b5365eda7e3431a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b09c77f0-b246-58a1-bd7c-e14d7272a1f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 74728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b09c77f0-b246-58a1-bd7c-e14d7272a1f1/b09c77f0-b246-58a1-bd7c-e14d7272a1f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/212/6e5a0b3a1d3149f9b5365eda7e3431a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981565%27 HTTP/1.1" 200 None
2026-03-24 18:34:58 [ayvens.es] INFO: Saving data for 1981565: {'created_time': 1774377298.131639, 'last_price_update_time': 1774377298.131655, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981565') HTTP/1.1" 204 0
2026-03-24 18:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/929/599394764f0c4ce7b4e2ff3f14ee1216/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/926/e66c558f7ba148d3a05619c613597388/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:58 [ayvens.es] INFO: Found listing with ID: 1981575
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981575%27 HTTP/1.1" 200 None
2026-03-24 18:34:58 [ayvens.es] INFO: Scrape type for 1981575: 1
2026-03-24 18:34:58 [ayvens.es] INFO: Extracting data for car ID: 1981575
2026-03-24 18:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c4d9a9-8283-5b3a-91c7-9592b15db6a5 with identifier: 1981575
2026-03-24 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c4d9a9-8283-5b3a-91c7-9592b15db6a5 with scrape type 1
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8c4d9a9-8283-5b3a-91c7-9592b15db6a5
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F1ca48e65c8e94ab085f658d0b401161d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/1ca48e65c8e94ab085f658d0b401161d/images/large/1.jpg not downloaded yet
2026-03-24 18:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/078/8f622fbb8d8a44ed84802d1647335620/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f05cf5d0>
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f10af1-4933-564c-8a84-2026967307aa/21f10af1-4933-564c-8a84-2026967307aa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F407%252Fdcaa187c884d4c94a4e6969c107bd2d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/407/dcaa187c884d4c94a4e6969c107bd2d5/images/large/1.jpg saved to cache
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21f10af1-4933-564c-8a84-2026967307aa
2026-03-24 18:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21f10af1-4933-564c-8a84-2026967307aa, skipping ID generation
2026-03-24 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f10af1-4933-564c-8a84-2026967307aa with scrape type 1
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21f10af1-4933-564c-8a84-2026967307aa sending to next pipeline
2026-03-24 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21f10af1-4933-564c-8a84-2026967307aa, identifier: 1981567
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f0ad9750>
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69695edd-2a3c-517b-89a3-672a1297c69e/69695edd-2a3c-517b-89a3-672a1297c69e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F501%252Fca3bd311bf8a4cb890a6aa079dc680ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/501/ca3bd311bf8a4cb890a6aa079dc680ad/images/large/1.jpg saved to cache
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69695edd-2a3c-517b-89a3-672a1297c69e
2026-03-24 18:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69695edd-2a3c-517b-89a3-672a1297c69e, skipping ID generation
2026-03-24 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69695edd-2a3c-517b-89a3-672a1297c69e with scrape type 1
2026-03-24 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69695edd-2a3c-517b-89a3-672a1297c69e sending to next pipeline
2026-03-24 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69695edd-2a3c-517b-89a3-672a1297c69e, identifier: 1981568
2026-03-24 18:34:58 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-24 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21f10af1-4933-564c-8a84-2026967307aa with identifier: 1981567
2026-03-24 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21f10af1-4933-564c-8a84-2026967307aa with identifier: 1981567
2026-03-24 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21f10af1-4933-564c-8a84-2026967307aa with identifier: 1981567 to the API
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/407/dcaa187c884d4c94a4e6969c107bd2d5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '21f10af1-4933-564c-8a84-2026967307aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 139947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f10af1-4933-564c-8a84-2026967307aa/21f10af1-4933-564c-8a84-2026967307aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/407/dcaa187c884d4c94a4e6969c107bd2d5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE TECH ROAD Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'TECH ROAD Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2018}
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981567%27 HTTP/1.1" 200 None
2026-03-24 18:34:58 [ayvens.es] INFO: Saving data for 1981567: {'created_time': 1774377298.864608, 'last_price_update_time': 1774377298.864617, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981567') HTTP/1.1" 204 0
2026-03-24 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69695edd-2a3c-517b-89a3-672a1297c69e with identifier: 1981568
2026-03-24 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69695edd-2a3c-517b-89a3-672a1297c69e with identifier: 1981568
2026-03-24 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 69695edd-2a3c-517b-89a3-672a1297c69e with identifier: 1981568 to the API
2026-03-24 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/501/ca3bd311bf8a4cb890a6aa079dc680ad/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '69695edd-2a3c-517b-89a3-672a1297c69e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 174731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69695edd-2a3c-517b-89a3-672a1297c69e/69695edd-2a3c-517b-89a3-672a1297c69e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/501/ca3bd311bf8a4cb890a6aa079dc680ad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2018}
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981568%27 HTTP/1.1" 200 None
2026-03-24 18:34:59 [ayvens.es] INFO: Saving data for 1981568: {'created_time': 1774377299.219772, 'last_price_update_time': 1774377299.219781, 'auction_closing_time': 1774440000.0}
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981568') HTTP/1.1" 204 0
2026-03-24 18:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/249/68f493e8c49a4e149747efd302758e83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91f09f1910>
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b/e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F929%252F599394764f0c4ce7b4e2ff3f14ee1216%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/929/599394764f0c4ce7b4e2ff3f14ee1216/images/large/1.jpg saved to cache
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b
2026-03-24 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b, skipping ID generation
2026-03-24 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with scrape type 1
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b sending to next pipeline
2026-03-24 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b, identifier: 1981566
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91eecab590>
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c/8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F926%252Fe66c558f7ba148d3a05619c613597388%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/926/e66c558f7ba148d3a05619c613597388/images/large/1.jpg saved to cache
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c
2026-03-24 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c, skipping ID generation
2026-03-24 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c with scrape type 1
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c sending to next pipeline
2026-03-24 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c, identifier: 1981569
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91fe2a9ad0>
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d7dc57b-6600-5d1b-9eb3-2847598672fd/9d7dc57b-6600-5d1b-9eb3-2847598672fd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252F8f622fbb8d8a44ed84802d1647335620%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/8f622fbb8d8a44ed84802d1647335620/images/large/1.jpg saved to cache
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd
2026-03-24 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d7dc57b-6600-5d1b-9eb3-2847598672fd, skipping ID generation
2026-03-24 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd with scrape type 1
2026-03-24 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd sending to next pipeline
2026-03-24 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d7dc57b-6600-5d1b-9eb3-2847598672fd, identifier: 1981570
2026-03-24 18:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/584/751fb686f8a84ab283a52c1d30657a59/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1981566
2026-03-24 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1981566
2026-03-24 18:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1981566 to the API
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/929/599394764f0c4ce7b4e2ff3f14ee1216/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Rojo elixir',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 52782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b/e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/929/599394764f0c4ce7b4e2ff3f14ee1216/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-24 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981566%27 HTTP/1.1" 200 None
2026-03-24 18:35:00 [ayvens.es] INFO: Saving data for 1981566: {'created_time': 1774377300.005095, 'last_price_update_time': 1774377300.005112, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981566') HTTP/1.1" 204 0
2026-03-24 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c with identifier: 1981569
2026-03-24 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c with identifier: 1981569
2026-03-24 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c with identifier: 1981569 to the API
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/926/e66c558f7ba148d3a05619c613597388/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Asphalt blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 129797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c/8fe0ed85-6ef1-56f7-b27a-e9d81a99d47c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/926/e66c558f7ba148d3a05619c613597388/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 1.5 eTSI 110kW DSG S&S FR Go L',
 'transmission': 'manual',
 'trim': 'SP 1.5 eTSI 110kW DSG S&S FR Go L',
 'vin': None,
 'year': 2021}
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981569%27 HTTP/1.1" 200 None
2026-03-24 18:35:00 [ayvens.es] INFO: Saving data for 1981569: {'created_time': 1774377300.411845, 'last_price_update_time': 1774377300.411856, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981569') HTTP/1.1" 204 0
2026-03-24 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1981570
2026-03-24 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1981570
2026-03-24 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1981570 to the API
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/078/8f622fbb8d8a44ed84802d1647335620/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Azul makro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d7dc57b-6600-5d1b-9eb3-2847598672fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 131432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d7dc57b-6600-5d1b-9eb3-2847598672fd/9d7dc57b-6600-5d1b-9eb3-2847598672fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/078/8f622fbb8d8a44ed84802d1647335620/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2018}
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981570%27 HTTP/1.1" 200 None
2026-03-24 18:35:00 [ayvens.es] INFO: Saving data for 1981570: {'created_time': 1774377300.743639, 'last_price_update_time': 1774377300.743649, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981570') HTTP/1.1" 204 0
2026-03-24 18:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/182/395e78a2a6bc48308a5c62b9ab5411fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91fe290f50>
2026-03-24 18:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a291efa0-a328-5d44-bd5f-8cb0293a7daf/a291efa0-a328-5d44-bd5f-8cb0293a7daf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252F68f493e8c49a4e149747efd302758e83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/68f493e8c49a4e149747efd302758e83/images/large/1.jpg saved to cache
2026-03-24 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a291efa0-a328-5d44-bd5f-8cb0293a7daf
2026-03-24 18:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a291efa0-a328-5d44-bd5f-8cb0293a7daf, skipping ID generation
2026-03-24 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a291efa0-a328-5d44-bd5f-8cb0293a7daf with scrape type 1
2026-03-24 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a291efa0-a328-5d44-bd5f-8cb0293a7daf sending to next pipeline
2026-03-24 18:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a291efa0-a328-5d44-bd5f-8cb0293a7daf, identifier: 1981571
2026-03-24 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a291efa0-a328-5d44-bd5f-8cb0293a7daf with identifier: 1981571
2026-03-24 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a291efa0-a328-5d44-bd5f-8cb0293a7daf with identifier: 1981571
2026-03-24 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a291efa0-a328-5d44-bd5f-8cb0293a7daf with identifier: 1981571 to the API
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/249/68f493e8c49a4e149747efd302758e83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a291efa0-a328-5d44-bd5f-8cb0293a7daf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 90789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a291efa0-a328-5d44-bd5f-8cb0293a7daf/a291efa0-a328-5d44-bd5f-8cb0293a7daf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/249/68f493e8c49a4e149747efd302758e83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style XL',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style XL',
 'vin': None,
 'year': 2023}
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981571%27 HTTP/1.1" 200 None
2026-03-24 18:35:01 [ayvens.es] INFO: Saving data for 1981571: {'created_time': 1774377301.233419, 'last_price_update_time': 1774377301.233429, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981571') HTTP/1.1" 204 0
2026-03-24 18:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/612/a88489ae0e264cc291fd51a1286ea9cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee7c7ed0>
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247d8c0a-8ddb-5ae6-b0ef-e170220c5412/247d8c0a-8ddb-5ae6-b0ef-e170220c5412_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F584%252F751fb686f8a84ab283a52c1d30657a59%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/584/751fb686f8a84ab283a52c1d30657a59/images/large/1.jpg saved to cache
2026-03-24 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412
2026-03-24 18:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412, skipping ID generation
2026-03-24 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with scrape type 1
2026-03-24 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 sending to next pipeline
2026-03-24 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412, identifier: 1981572
2026-03-24 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1981572
2026-03-24 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1981572
2026-03-24 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1981572 to the API
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/584/751fb686f8a84ab283a52c1d30657a59/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '247d8c0a-8ddb-5ae6-b0ef-e170220c5412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 89216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_247d8c0a-8ddb-5ae6-b0ef-e170220c5412/247d8c0a-8ddb-5ae6-b0ef-e170220c5412_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/584/751fb686f8a84ab283a52c1d30657a59/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981572%27 HTTP/1.1" 200 None
2026-03-24 18:35:01 [ayvens.es] INFO: Saving data for 1981572: {'created_time': 1774377301.701686, 'last_price_update_time': 1774377301.701698, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981572') HTTP/1.1" 204 0
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9c2d90>
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84032d6d-278f-5e60-91c1-eda367930657/84032d6d-278f-5e60-91c1-eda367930657_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F182%252F395e78a2a6bc48308a5c62b9ab5411fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/182/395e78a2a6bc48308a5c62b9ab5411fd/images/large/1.jpg saved to cache
2026-03-24 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84032d6d-278f-5e60-91c1-eda367930657
2026-03-24 18:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84032d6d-278f-5e60-91c1-eda367930657, skipping ID generation
2026-03-24 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84032d6d-278f-5e60-91c1-eda367930657 with scrape type 1
2026-03-24 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84032d6d-278f-5e60-91c1-eda367930657 sending to next pipeline
2026-03-24 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84032d6d-278f-5e60-91c1-eda367930657, identifier: 1981573
2026-03-24 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84032d6d-278f-5e60-91c1-eda367930657 with identifier: 1981573
2026-03-24 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84032d6d-278f-5e60-91c1-eda367930657 with identifier: 1981573
2026-03-24 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84032d6d-278f-5e60-91c1-eda367930657 with identifier: 1981573 to the API
2026-03-24 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/182/395e78a2a6bc48308a5c62b9ab5411fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Negro prof efec',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '84032d6d-278f-5e60-91c1-eda367930657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 202138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84032d6d-278f-5e60-91c1-eda367930657/84032d6d-278f-5e60-91c1-eda367930657_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/182/395e78a2a6bc48308a5c62b9ab5411fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981573%27 HTTP/1.1" 200 None
2026-03-24 18:35:02 [ayvens.es] INFO: Saving data for 1981573: {'created_time': 1774377302.191647, 'last_price_update_time': 1774377302.191658, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981573') HTTP/1.1" 204 0
2026-03-24 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/355/1ca48e65c8e94ab085f658d0b401161d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee9c3ed0>
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f3329f-4b6b-55a3-bfc7-ad6807d93ac0/66f3329f-4b6b-55a3-bfc7-ad6807d93ac0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F612%252Fa88489ae0e264cc291fd51a1286ea9cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/612/a88489ae0e264cc291fd51a1286ea9cd/images/large/1.jpg saved to cache
2026-03-24 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0
2026-03-24 18:35:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0, skipping ID generation
2026-03-24 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0 with scrape type 1
2026-03-24 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0 sending to next pipeline
2026-03-24 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0, identifier: 1981574
2026-03-24 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0 with identifier: 1981574
2026-03-24 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0 with identifier: 1981574
2026-03-24 18:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 66f3329f-4b6b-55a3-bfc7-ad6807d93ac0 with identifier: 1981574 to the API
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/612/a88489ae0e264cc291fd51a1286ea9cd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '66f3329f-4b6b-55a3-bfc7-ad6807d93ac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 51569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f3329f-4b6b-55a3-bfc7-ad6807d93ac0/66f3329f-4b6b-55a3-bfc7-ad6807d93ac0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/612/a88489ae0e264cc291fd51a1286ea9cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981574%27 HTTP/1.1" 200 None
2026-03-24 18:35:02 [ayvens.es] INFO: Saving data for 1981574: {'created_time': 1774377302.75221, 'last_price_update_time': 1774377302.752219, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981574') HTTP/1.1" 204 0
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91ee1f1a50>
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 18:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8c4d9a9-8283-5b3a-91c7-9592b15db6a5/d8c4d9a9-8283-5b3a-91c7-9592b15db6a5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F1ca48e65c8e94ab085f658d0b401161d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/1ca48e65c8e94ab085f658d0b401161d/images/large/1.jpg saved to cache
2026-03-24 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8c4d9a9-8283-5b3a-91c7-9592b15db6a5
2026-03-24 18:35:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8c4d9a9-8283-5b3a-91c7-9592b15db6a5, skipping ID generation
2026-03-24 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c4d9a9-8283-5b3a-91c7-9592b15db6a5 with scrape type 1
2026-03-24 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8c4d9a9-8283-5b3a-91c7-9592b15db6a5 sending to next pipeline
2026-03-24 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d8c4d9a9-8283-5b3a-91c7-9592b15db6a5, identifier: 1981575
2026-03-24 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d8c4d9a9-8283-5b3a-91c7-9592b15db6a5 with identifier: 1981575
2026-03-24 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d8c4d9a9-8283-5b3a-91c7-9592b15db6a5 with identifier: 1981575
2026-03-24 18:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d8c4d9a9-8283-5b3a-91c7-9592b15db6a5 with identifier: 1981575 to the API
2026-03-24 18:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 18:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 18:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/355/1ca48e65c8e94ab085f658d0b401161d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd8c4d9a9-8283-5b3a-91c7-9592b15db6a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40984',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 60692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c4d9a9-8283-5b3a-91c7-9592b15db6a5/d8c4d9a9-8283-5b3a-91c7-9592b15db6a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/355/1ca48e65c8e94ab085f658d0b401161d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-03-24 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271981575%27 HTTP/1.1" 200 None
2026-03-24 18:35:03 [ayvens.es] INFO: Saving data for 1981575: {'created_time': 1774377303.244724, 'last_price_update_time': 1774377303.244734, 'auction_closing_time': 1774440000.0}
2026-03-24 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1981575') HTTP/1.1" 204 0
2026-03-24 18:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 18:35:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-24 18:35:04 [ayvens.es] INFO: ayvens.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 9, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-24 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20last_price_update_time%20lt%201773945304 HTTP/1.1" 200 None
2026-03-24 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971921') HTTP/1.1" 204 0
2026-03-24 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971922') HTTP/1.1" 204 0
2026-03-24 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971923') HTTP/1.1" 204 0
2026-03-24 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971924') HTTP/1.1" 204 0
2026-03-24 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971925') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971926') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971927') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971928') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971929') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971930') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971931') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971932') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971933') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971934') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971935') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971936') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971937') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971938') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971939') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971940') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971941') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971942') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971943') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971944') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971945') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971946') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971947') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971948') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971949') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971950') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971951') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971952') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971953') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971954') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971955') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971956') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971957') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971958') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971959') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971960') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971961') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971962') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971963') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971964') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971965') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971966') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971967') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971968') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971969') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971970') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971971') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971972') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971973') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971974') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971975') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971976') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971977') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971978') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971979') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971980') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971981') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971982') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971983') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971984') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971985') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971986') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971987') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971988') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971989') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971990') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971991') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971992') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971993') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971994') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971995') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971996') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971997') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971998') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1971999') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972000') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972001') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972002') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972003') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972004') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972005') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972006') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972007') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972008') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972009') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972010') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972011') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972012') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972013') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972014') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972015') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972016') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972017') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972018') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972019') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972020') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972021') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972022') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972023') HTTP/1.1" 204 0
2026-03-24 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972024') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972025') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972026') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972027') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972028') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972029') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972030') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972031') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972032') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972033') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972034') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972035') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972036') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972037') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972038') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972039') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972040') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972041') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972042') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972043') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972044') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972045') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972046') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972047') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972048') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972049') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972050') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972051') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972052') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972053') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972054') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972055') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972056') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972057') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972058') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972059') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972060') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972061') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972062') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972063') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972064') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972065') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972066') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972067') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972068') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972069') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972070') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972580') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972581') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972582') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972583') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972584') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972585') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972586') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972587') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972588') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972589') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972590') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972591') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972592') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972593') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972594') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972595') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972596') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972597') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972598') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972599') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972600') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972601') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972602') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972603') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972604') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972605') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972606') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972607') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972608') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972609') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972610') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972611') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972612') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972613') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972614') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972615') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972616') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972617') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972618') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972619') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972620') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972621') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972622') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972623') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972624') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972625') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972626') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972627') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972628') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972629') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972630') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972631') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972632') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972633') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972634') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972635') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972636') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972637') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972638') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972639') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972640') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972641') HTTP/1.1" 204 0
2026-03-24 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972642') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972643') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972644') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972645') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972646') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972647') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972648') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972649') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972650') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972651') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972652') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972653') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972654') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972655') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972656') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972657') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972658') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972659') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972660') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972661') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972662') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972663') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972664') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972665') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972666') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972667') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972668') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972669') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972670') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972671') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972672') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972673') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972674') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972675') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972676') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972677') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972678') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972679') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972680') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972681') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972682') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972683') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972684') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972685') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972686') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972687') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972688') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972689') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972690') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972691') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972692') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972693') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972694') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972695') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972696') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972697') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972698') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972699') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972700') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972701') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972702') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972703') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972704') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972705') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972706') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972707') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972708') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972709') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972710') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972711') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972712') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972713') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972714') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972715') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972716') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972717') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972718') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972719') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972720') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972721') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972722') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972723') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972724') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972725') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972726') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972727') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972728') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972729') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972730') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972731') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972732') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972733') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972734') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972735') HTTP/1.1" 204 0
2026-03-24 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972736') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972737') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972738') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972739') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972740') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972741') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972742') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972743') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972744') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972745') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972746') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972747') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972748') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972749') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972750') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972751') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972752') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972753') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972754') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972755') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972756') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972757') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972758') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972759') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972760') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972761') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972762') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972763') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972764') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972765') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972766') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972767') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972768') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972769') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972770') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972771') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972772') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972773') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972774') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972775') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972776') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972777') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972778') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972779') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972780') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972781') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972782') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972783') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972784') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972785') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972786') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972787') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972788') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972789') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972790') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972791') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972792') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972793') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972794') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972795') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972796') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972797') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972798') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972799') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972800') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972801') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972802') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972803') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972804') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972805') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972806') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972807') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972808') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972809') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972810') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972811') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972812') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972813') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972814') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972815') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972816') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972817') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972818') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972819') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972820') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972821') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972822') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972823') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972824') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972825') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972826') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972827') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972828') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972829') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972830') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972831') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972832') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972833') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972834') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972835') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972836') HTTP/1.1" 204 0
2026-03-24 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972837') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972838') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972839') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972840') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972841') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972842') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972843') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972844') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972845') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972846') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972847') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972848') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972849') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972850') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972851') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972852') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972853') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972854') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972855') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972856') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972857') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972858') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972859') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972860') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972861') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972862') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972863') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972864') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972865') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972866') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972867') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972868') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972869') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972870') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972871') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972872') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972873') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972874') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972875') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972876') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972877') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972878') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972879') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972880') HTTP/1.1" 204 0
2026-03-24 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1972888') HTTP/1.1" 204 0
2026-03-24 18:35:09 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (462 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.es/task_38_2026-03-24T18_30_00.jl
2026-03-24 18:35:09 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-24 18:35:09 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 221920,
 'downloader/request_count': 466,
 'downloader/request_method_count/GET': 460,
 'downloader/request_method_count/POST': 6,
 'downloader/response_bytes': 187892763,
 'downloader/response_count': 466,
 'downloader/response_status_count/200': 466,
 'elapsed_time_seconds': 303.84674,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 24, 18, 35, 9, 425028, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 462,
 'log_count/DEBUG': 8841,
 'log_count/INFO': 9470,
 'memusage/max': 187056128,
 'memusage/startup': 147636224,
 'photo_download_count': 459,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 172,
 'playwright/request_count/aborted': 14,
 'playwright/request_count/method/GET': 162,
 'playwright/request_count/method/POST': 10,
 'playwright/request_count/navigation': 5,
 'playwright/request_count/resource_type/document': 5,
 'playwright/request_count/resource_type/fetch': 12,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 42,
 'playwright/request_count/resource_type/other': 1,
 'playwright/request_count/resource_type/script': 89,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 6,
 'playwright/response_count': 155,
 'playwright/response_count/method/GET': 147,
 'playwright/response_count/method/POST': 8,
 'playwright/response_count/resource_type/document': 5,
 'playwright/response_count/resource_type/fetch': 11,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 27,
 'playwright/response_count/resource_type/other': 1,
 'playwright/response_count/resource_type/script': 89,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 5,
 'request_depth_max': 6,
 'response_received_count': 7,
 'scheduler/dequeued': 466,
 'scheduler/dequeued/memory': 466,
 'scheduler/enqueued': 466,
 'scheduler/enqueued/memory': 466,
 'scrape_type/new': 462,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 6,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.959508122333015,
 'scrapy-zyte-api/mean_response_seconds': 4.978284331349035,
 'scrapy-zyte-api/processed': 6,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
 'scrapy-zyte-api/request_args/httpRequestBody': 6,
 'scrapy-zyte-api/request_args/httpRequestMethod': 6,
 'scrapy-zyte-api/request_args/httpResponseBody': 6,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
 'scrapy-zyte-api/request_args/url': 6,
 'scrapy-zyte-api/status_codes/200': 6,
 'scrapy-zyte-api/success': 6,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 24, 18, 30, 5, 578288, tzinfo=datetime.timezone.utc)}
2026-03-24 18:35:09 [scrapy.core.engine] INFO: Spider closed (finished)