2026-01-28 20:00:11 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 20:00:11 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 20:00:11 [ayvens.es] INFO: Starting spider ayvens.es
2026-01-28 20:00:11 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 20:00:11 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 20:00:11 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 20:00:11 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 20:00:11 [scrapy.extensions.telnet] INFO: Telnet Password: cb6c30c7facf5177
2026-01-28 20:00:12 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-28 20:00:12 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.es/task_54_2026-01-28T20_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-28 20:00:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:12 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 20:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-28 20:00:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 20:00:12 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-28 20:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:12 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 20:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 20:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:12 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-01-28 20:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-01-28 20:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-28 20:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-28 20:00:12 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-28 20:00:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-28 20:00:12 [scrapy.core.engine] INFO: Spider opened
2026-01-28 20:00:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 20:00:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-01-28 20:00:12 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:12 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:17 [scrapy-playwright] INFO: Launching browser firefox
2026-01-28 20:00:18 [scrapy-playwright] INFO: Browser firefox launched
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4QVFFAQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7YT6ABHA.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WFA2IVWG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LVJXO4QX.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2N74OY7W.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KZOV2SQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-P3E7UHUI.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WE77U2QS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-O3OWKDIN.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4QVFFAQG.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-G7VKZLNV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-4QVFFAQG.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7YT6ABHA.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WFA2IVWG.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LVJXO4QX.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2N74OY7W.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KZOV2SQ2.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-P3E7UHUI.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WE77U2QS.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-IOF7VMBJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-4QVFFAQG.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PGNL7WWW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RQLFCBMH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3HJTOVT5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-O3OWKDIN.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-S5E5FHXZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGXSF4AK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5HD3KQV3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FB6RKR5I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ALI5XYZJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LHCNJE3I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7C2GTJ24.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CMYMW4RH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-276SS4TV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7KVSNWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OION63CA.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NO5FJ6IE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJGQXDQB.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MADFXCQX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-57LOL62V.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JK3VA6V3.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ECZFIAAV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RWL6TUXQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3ZRJENLY.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-35VRT2WM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WJPXCSUZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-GWHLDUVT.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LYOOO25D.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7LLFTWQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-G7VKZLNV.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-IOF7VMBJ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PGNL7WWW.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RQLFCBMH.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGXSF4AK.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3HJTOVT5.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-S5E5FHXZ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5HD3KQV3.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FB6RKR5I.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ALI5XYZJ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LHCNJE3I.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7C2GTJ24.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CMYMW4RH.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-276SS4TV.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7KVSNWE.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OION63CA.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NO5FJ6IE.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MADFXCQX.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJGQXDQB.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-57LOL62V.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JK3VA6V3.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RWL6TUXQ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ECZFIAAV.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3ZRJENLY.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-35VRT2WM.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WJPXCSUZ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-GWHLDUVT.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LYOOO25D.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7LLFTWQ2.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HLMVA2XG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HLMVA2XG.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7WQD6B5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HLMVA2XG.js)
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7WQD6B5.js>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-01-28 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7P3LAPEA.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-28 20:00:26 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7P3LAPEA.js>
2026-01-28 20:00:26 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6TCU7CUH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:26 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-TXAFC7UM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:26 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MIPFLQ72.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6TCU7CUH.js>
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-TXAFC7UM.js>
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MIPFLQ72.js>
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJDFUE4N.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPJAYUCB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OIQIERBW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-UFB65P4A.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NTG4JAHX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7TECJER3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJDFUE4N.js>
2026-01-28 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPJAYUCB.js>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-UFB65P4A.js>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OIQIERBW.js>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NTG4JAHX.js>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7TECJER3.js>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K3XLXP2R.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HBBQKHO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-UFB65P4A.js)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HXFSIYAP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QMSFYIWN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K3XLXP2R.js>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HBBQKHO4.js>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HXFSIYAP.js>
2026-01-28 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VZKIXU23.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EOYYGPOY.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QMSFYIWN.js>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6YCHXE2J.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:29 [ayvens.es] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': '2fLTN09qq3yzXU+7rO+etl|2026-01-28T20:00:24.911Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1801166424, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'eyKBbsplvk/qcoQIYmO6nm|1769630428354|1769630428354', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1769632228, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-01-28 20:00:29 [ayvens.es] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': '2fLTN09qq3yzXU+7rO+etl|2026-01-28T20:00:24.911Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'eyKBbsplvk/qcoQIYmO6nm|1769630428354|1769630428354', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-01-28 20:00:29 [ayvens.es] INFO: Intercepting token...
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/dk.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/dk.svg>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VZKIXU23.js>
2026-01-28 20:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LMJCIPKN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7TECJER3.js)
2026-01-28 20:00:29 [ayvens.es] INFO: Scrolling element to trigger lazy load...
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EOYYGPOY.js>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6YCHXE2J.js>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/dm.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/reset.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LMJCIPKN.js>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/dw7/8b1aef661a0944bbbaccd6271edef5f7/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/dp3/38b2b454f0ec4e12b9279270739f4235/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/dm.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/reset.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MSBSCS6P.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MSBSCS6P.js>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-T4CT3E3U.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MSBSCS6P.js)
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-T4CT3E3U.js>
2026-01-28 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-01-28 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/dp3/38b2b454f0ec4e12b9279270739f4235/images/medium/0.jpg>
2026-01-28 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/medium/0.jpg>
2026-01-28 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/dw7/8b1aef661a0944bbbaccd6271edef5f7/images/medium/0.jpg>
2026-01-28 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/medium/0.jpg>
2026-01-28 20:00:32 [ayvens.es] INFO: GraphQL headers: {'host': 'api.aldcarmarket.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'cross-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9QdGpxbi1jYy1FVTpLSks1eEVqSGtGek1GOFRBWEJoek1NckV5dFVYamZ1ZnhYQ0YzOFQ3ejMwNGo5TmtqRDJGNnhTdzdqNGRBdGFE', 'connection': 'keep-alive'}
2026-01-28 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api.aldcarmarket.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-01-28 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-01-28 20:00:34 [ayvens.es] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-01-28 20:00:34 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-01-28 20:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878330
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878330%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878330: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878330
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f435f8dc-eeff-54e9-a5fd-cfd4534665b5 with identifier: 1878330
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f435f8dc-eeff-54e9-a5fd-cfd4534665b5 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f435f8dc-eeff-54e9-a5fd-cfd4534665b5
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252F339de64e4f1d4454a645c490c94e3eaa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/339de64e4f1d4454a645c490c94e3eaa/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878331
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878331%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878331: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878331
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9960805-63a5-5762-bf6b-40154e4dbcbe with identifier: 1878331
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9960805-63a5-5762-bf6b-40154e4dbcbe with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9960805-63a5-5762-bf6b-40154e4dbcbe
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F548380a073234deb884367e029a10a57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/548380a073234deb884367e029a10a57/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878332
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878332%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878332: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878332
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab760f32-aee6-585a-b421-5e24bcd993db with identifier: 1878332
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab760f32-aee6-585a-b421-5e24bcd993db with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab760f32-aee6-585a-b421-5e24bcd993db
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F549%252F6e1f74c022d24d74ad4c0eee83a994c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878333
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878333%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878333: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878333
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9948d85c-9a1e-526a-994e-d60d0dd7c502 with identifier: 1878333
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9948d85c-9a1e-526a-994e-d60d0dd7c502 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9948d85c-9a1e-526a-994e-d60d0dd7c502
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F717%252F560118a233394a13be0a594d0380519b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/717/560118a233394a13be0a594d0380519b/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878334
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878334%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878334: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878334
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf91c272-01e2-5170-bae2-2980861d41e1 with identifier: 1878334
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf91c272-01e2-5170-bae2-2980861d41e1 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cf91c272-01e2-5170-bae2-2980861d41e1
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F583%252Fda9a1ea961ec4fbfb5b958cc0785ed72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878335
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878335%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878335: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878335
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d23f3968-bc5e-54b6-a64e-e58a79ffb698 with identifier: 1878335
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d23f3968-bc5e-54b6-a64e-e58a79ffb698 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d23f3968-bc5e-54b6-a64e-e58a79ffb698
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252Fdafd5404d7a84b50a5b87c16312f85f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/dafd5404d7a84b50a5b87c16312f85f2/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878336
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878336%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878336: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878336
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327218c4-89d3-5beb-8c84-983263fadbe3 with identifier: 1878336
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327218c4-89d3-5beb-8c84-983263fadbe3 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 327218c4-89d3-5beb-8c84-983263fadbe3
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F380%252F6e3599f4011e486bb3dba3905f57fe7a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878337
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878337%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878337: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878337
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 301ae193-e20d-5d05-9b74-5d29453e8bfd with identifier: 1878337
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 301ae193-e20d-5d05-9b74-5d29453e8bfd with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 301ae193-e20d-5d05-9b74-5d29453e8bfd
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F473%252Fc42c084382af4705884508970fdd4391%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/473/c42c084382af4705884508970fdd4391/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878338
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878338%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878338: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878338
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e with identifier: 1878338
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F358871e2f0cc4cd79937068f6c5f9da7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/358871e2f0cc4cd79937068f6c5f9da7/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878339
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878339%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878339: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878339
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e461514-1912-5108-936c-1bcdc0e9c349 with identifier: 1878339
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e461514-1912-5108-936c-1bcdc0e9c349 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e461514-1912-5108-936c-1bcdc0e9c349
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F679%252F945cebc9f59c4b43af120ac2c4306048%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/679/945cebc9f59c4b43af120ac2c4306048/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878340
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878340%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878340: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878340
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e45c1de-623b-51d4-a32d-291853643c11 with identifier: 1878340
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e45c1de-623b-51d4-a32d-291853643c11 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e45c1de-623b-51d4-a32d-291853643c11
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F016%252Fa7f2fe13f0e746c2acf23c680a00283e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/016/a7f2fe13f0e746c2acf23c680a00283e/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878341
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878341%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878341: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878341
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe46cf59-ca91-5219-ac74-6ae897093590 with identifier: 1878341
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe46cf59-ca91-5219-ac74-6ae897093590 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fe46cf59-ca91-5219-ac74-6ae897093590
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F906%252F9ee3241e24e2472fa8c6cda093dab726%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/906/9ee3241e24e2472fa8c6cda093dab726/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878342
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878342%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878342: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878342
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7987af9-e544-5867-ae0b-53b74a621c0b with identifier: 1878342
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7987af9-e544-5867-ae0b-53b74a621c0b with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a7987af9-e544-5867-ae0b-53b74a621c0b
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F364%252F0ca14fe447fe4815966951cc16b5da95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/364/0ca14fe447fe4815966951cc16b5da95/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878343
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878343%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878343: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878343
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6294248e-77fc-5b24-bc87-65b1b4aba35e with identifier: 1878343
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6294248e-77fc-5b24-bc87-65b1b4aba35e with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6294248e-77fc-5b24-bc87-65b1b4aba35e
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F737%252F4fe7208757084fbabd3ba672093a4dbc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/737/4fe7208757084fbabd3ba672093a4dbc/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878344
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878344%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878344: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878344
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd81ecf7-cb09-5ee4-8751-5967a15fec77 with identifier: 1878344
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd81ecf7-cb09-5ee4-8751-5967a15fec77 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dd81ecf7-cb09-5ee4-8751-5967a15fec77
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F641%252Fffea973dc860481daa0df6465f78dba0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/641/ffea973dc860481daa0df6465f78dba0/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878345
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878345%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878345: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878345
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 with identifier: 1878345
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90f9f99e-6cd1-5b81-b528-1312f88eb4a0
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252Fe8d41d366a0c467e90241cd551e5cb22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/e8d41d366a0c467e90241cd551e5cb22/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878346
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878346%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878346: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878346
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7019ce51-fafa-5672-895d-5adc1d6fa8da with identifier: 1878346
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7019ce51-fafa-5672-895d-5adc1d6fa8da with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7019ce51-fafa-5672-895d-5adc1d6fa8da
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252Fe5b8d4dda5ff4d2387939b3a3f6ea644%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/e5b8d4dda5ff4d2387939b3a3f6ea644/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [ayvens.es] INFO: Found listing with ID: 1878347
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878347%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.es] INFO: Scrape type for 1878347: 1
2026-01-28 20:00:36 [ayvens.es] INFO: Extracting data for car ID: 1878347
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1c4ade9-9346-5005-8e03-193e32636ff4 with identifier: 1878347
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c4ade9-9346-5005-8e03-193e32636ff4 with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1c4ade9-9346-5005-8e03-193e32636ff4
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F983%252F67dabdfb60b74f3f808007091cc7d545%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/983/67dabdfb60b74f3f808007091cc7d545/images/large/1.jpg not downloaded yet
2026-01-28 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/537/548380a073234deb884367e029a10a57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:37 [ayvens.es] INFO: Found listing with ID: 1878348
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878348%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [ayvens.es] INFO: Scrape type for 1878348: 1
2026-01-28 20:00:37 [ayvens.es] INFO: Extracting data for car ID: 1878348
2026-01-28 20:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09aaac4a-181c-5eb0-bcf9-76b869648e27 with identifier: 1878348
2026-01-28 20:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09aaac4a-181c-5eb0-bcf9-76b869648e27 with scrape type 1
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09aaac4a-181c-5eb0-bcf9-76b869648e27
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F999%252F98323eec9e604cac9612c432ac97c040%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/999/98323eec9e604cac9612c432ac97c040/images/large/1.jpg not downloaded yet
2026-01-28 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/717/560118a233394a13be0a594d0380519b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:37 [ayvens.es] INFO: Found listing with ID: 1878349
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878349%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [ayvens.es] INFO: Scrape type for 1878349: 1
2026-01-28 20:00:37 [ayvens.es] INFO: Extracting data for car ID: 1878349
2026-01-28 20:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 with identifier: 1878349
2026-01-28 20:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 with scrape type 1
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 293a78a6-cbc9-589e-bcff-0cb3fe0788b0
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F701%252F1a095a5db6664fccb863dd1fa3a0cbee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/701/1a095a5db6664fccb863dd1fa3a0cbee/images/large/1.jpg not downloaded yet
2026-01-28 20:00:37 [ayvens.es] INFO: Found listing with ID: 1878350
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878350%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [ayvens.es] INFO: Scrape type for 1878350: 1
2026-01-28 20:00:37 [ayvens.es] INFO: Extracting data for car ID: 1878350
2026-01-28 20:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23abeee0-13e7-52bf-a92c-f4f9800b09db with identifier: 1878350
2026-01-28 20:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23abeee0-13e7-52bf-a92c-f4f9800b09db with scrape type 1
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23abeee0-13e7-52bf-a92c-f4f9800b09db
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252Fee05bdc18b694059b888e5bae71e59e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/ee05bdc18b694059b888e5bae71e59e3/images/large/1.jpg not downloaded yet
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c90f1fd0>
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9960805-63a5-5762-bf6b-40154e4dbcbe/b9960805-63a5-5762-bf6b-40154e4dbcbe_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F548380a073234deb884367e029a10a57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/548380a073234deb884367e029a10a57/images/large/1.jpg saved to cache
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9960805-63a5-5762-bf6b-40154e4dbcbe
2026-01-28 20:00:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9960805-63a5-5762-bf6b-40154e4dbcbe, skipping ID generation
2026-01-28 20:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9960805-63a5-5762-bf6b-40154e4dbcbe with scrape type 1
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b9960805-63a5-5762-bf6b-40154e4dbcbe from tracking dictionaries
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9960805-63a5-5762-bf6b-40154e4dbcbe sending to next pipeline
2026-01-28 20:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9960805-63a5-5762-bf6b-40154e4dbcbe, identifier: 1878331
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:38 [ayvens.es] INFO: Found listing with ID: 1878351
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878351%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [ayvens.es] INFO: Scrape type for 1878351: 1
2026-01-28 20:00:38 [ayvens.es] INFO: Extracting data for car ID: 1878351
2026-01-28 20:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 435f134a-2126-5bb1-a424-8696b3eefb2c with identifier: 1878351
2026-01-28 20:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 435f134a-2126-5bb1-a424-8696b3eefb2c with scrape type 1
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 435f134a-2126-5bb1-a424-8696b3eefb2c
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252Fb11157ee51874535a0ec5d3435d823a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/b11157ee51874535a0ec5d3435d823a9/images/large/1.jpg not downloaded yet
2026-01-28 20:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9960805-63a5-5762-bf6b-40154e4dbcbe with identifier: 1878331
2026-01-28 20:00:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9960805-63a5-5762-bf6b-40154e4dbcbe with identifier: 1878331
2026-01-28 20:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
2026-01-28 20:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b9960805-63a5-5762-bf6b-40154e4dbcbe spider: ayvens.es
2026-01-28 20:00:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b9960805-63a5-5762-bf6b-40154e4dbcbe due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b9960805-63a5-5762-bf6b-40154e4dbcbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 79676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9960805-63a5-5762-bf6b-40154e4dbcbe/b9960805-63a5-5762-bf6b-40154e4dbcbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/537/548380a073234deb884367e029a10a57/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L1H2 3500 dCi 96kW (130CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L1H2 3500 dCi 96kW (130CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878331%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [ayvens.es] INFO: Saving data for 1878331: {'created_time': 1769630438.466622, 'last_price_update_time': 1769630438.466636, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878331') HTTP/1.1" 204 0
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/946/339de64e4f1d4454a645c490c94e3eaa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:38 [ayvens.es] INFO: Found listing with ID: 1878352
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878352%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [ayvens.es] INFO: Scrape type for 1878352: 1
2026-01-28 20:00:38 [ayvens.es] INFO: Extracting data for car ID: 1878352
2026-01-28 20:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7532722b-64e4-5dd3-948e-67d144a7de8e with identifier: 1878352
2026-01-28 20:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7532722b-64e4-5dd3-948e-67d144a7de8e with scrape type 1
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7532722b-64e4-5dd3-948e-67d144a7de8e
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F787%252F95ffe0aafbb24d5684babda47f8c2bb4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg not downloaded yet
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/249/dafd5404d7a84b50a5b87c16312f85f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:38 [ayvens.es] INFO: Found listing with ID: 1878353
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878353%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [ayvens.es] INFO: Scrape type for 1878353: 1
2026-01-28 20:00:38 [ayvens.es] INFO: Extracting data for car ID: 1878353
2026-01-28 20:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1542ef6-906a-50f6-aa95-0ba5498e4d07 with identifier: 1878353
2026-01-28 20:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1542ef6-906a-50f6-aa95-0ba5498e4d07 with scrape type 1
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a1542ef6-906a-50f6-aa95-0ba5498e4d07
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F094dc33bbf434cdebf51632cc59e6de6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/094dc33bbf434cdebf51632cc59e6de6/images/large/1.jpg not downloaded yet
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91afd50>
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf91c272-01e2-5170-bae2-2980861d41e1/cf91c272-01e2-5170-bae2-2980861d41e1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F583%252Fda9a1ea961ec4fbfb5b958cc0785ed72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg saved to cache
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf91c272-01e2-5170-bae2-2980861d41e1
2026-01-28 20:00:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf91c272-01e2-5170-bae2-2980861d41e1, skipping ID generation
2026-01-28 20:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf91c272-01e2-5170-bae2-2980861d41e1 with scrape type 1
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf91c272-01e2-5170-bae2-2980861d41e1 from tracking dictionaries
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf91c272-01e2-5170-bae2-2980861d41e1 sending to next pipeline
2026-01-28 20:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cf91c272-01e2-5170-bae2-2980861d41e1, identifier: 1878334
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca204310>
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9948d85c-9a1e-526a-994e-d60d0dd7c502/9948d85c-9a1e-526a-994e-d60d0dd7c502_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F717%252F560118a233394a13be0a594d0380519b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/717/560118a233394a13be0a594d0380519b/images/large/1.jpg saved to cache
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9948d85c-9a1e-526a-994e-d60d0dd7c502
2026-01-28 20:00:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9948d85c-9a1e-526a-994e-d60d0dd7c502, skipping ID generation
2026-01-28 20:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9948d85c-9a1e-526a-994e-d60d0dd7c502 with scrape type 1
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9948d85c-9a1e-526a-994e-d60d0dd7c502 from tracking dictionaries
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9948d85c-9a1e-526a-994e-d60d0dd7c502 sending to next pipeline
2026-01-28 20:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9948d85c-9a1e-526a-994e-d60d0dd7c502, identifier: 1878333
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fccad0>
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327218c4-89d3-5beb-8c84-983263fadbe3/327218c4-89d3-5beb-8c84-983263fadbe3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F380%252F6e3599f4011e486bb3dba3905f57fe7a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg saved to cache
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 327218c4-89d3-5beb-8c84-983263fadbe3
2026-01-28 20:00:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 327218c4-89d3-5beb-8c84-983263fadbe3, skipping ID generation
2026-01-28 20:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327218c4-89d3-5beb-8c84-983263fadbe3 with scrape type 1
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 327218c4-89d3-5beb-8c84-983263fadbe3 from tracking dictionaries
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 327218c4-89d3-5beb-8c84-983263fadbe3 sending to next pipeline
2026-01-28 20:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 327218c4-89d3-5beb-8c84-983263fadbe3, identifier: 1878336
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fd4bd0>
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab760f32-aee6-585a-b421-5e24bcd993db/ab760f32-aee6-585a-b421-5e24bcd993db_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F549%252F6e1f74c022d24d74ad4c0eee83a994c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg saved to cache
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab760f32-aee6-585a-b421-5e24bcd993db
2026-01-28 20:00:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab760f32-aee6-585a-b421-5e24bcd993db, skipping ID generation
2026-01-28 20:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab760f32-aee6-585a-b421-5e24bcd993db with scrape type 1
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab760f32-aee6-585a-b421-5e24bcd993db from tracking dictionaries
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab760f32-aee6-585a-b421-5e24bcd993db sending to next pipeline
2026-01-28 20:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab760f32-aee6-585a-b421-5e24bcd993db, identifier: 1878332
2026-01-28 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/260/358871e2f0cc4cd79937068f6c5f9da7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/679/945cebc9f59c4b43af120ac2c4306048/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cf91c272-01e2-5170-bae2-2980861d41e1 with identifier: 1878334
2026-01-28 20:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cf91c272-01e2-5170-bae2-2980861d41e1 with identifier: 1878334
2026-01-28 20:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo express', 'trim': 'profesional dci 66kw (90cv) euro 6', 'title': 'renault kangoo express profesional dci 66kw (90cv) euro 6', 'price': 0, 'odometer': 572451, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-10', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 3, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 112, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'cf91c272-01e2-5170-bae2-2980861d41e1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf91c272-01e2-5170-bae2-2980861d41e1/cf91c272-01e2-5170-bae2-2980861d41e1_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 330519}], 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'renault kangoo express', 'sanitized_make': 'renault', 'odometer_in_km': 572451}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 3,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'cf91c272-01e2-5170-bae2-2980861d41e1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo express',
     'model': 'kangoo express',
     'odometer': 572451,
     'odometer_in_km': 572451,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf91c272-01e2-5170-bae2-2980861d41e1/cf91c272-01e2-5170-bae2-2980861d41e1_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 330519,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-05-10',
     'sanitized_make': 'renault',
     'seats_number': 2,
     'seller_name': None,
     'title': 'renault kangoo express profesional dci 66kw (90cv) euro 6',
     'transmission': 'manual',
     'trim': 'profesional dci 66kw (90cv) euro 6',
     'vin': None,
     'year': 2018}
2026-01-28 20:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: cf91c272-01e2-5170-bae2-2980861d41e1 spider: ayvens.es
2026-01-28 20:00:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: cf91c272-01e2-5170-bae2-2980861d41e1 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo express', 'trim': 'profesional dci 66kw (90cv) euro 6', 'title': 'renault kangoo express profesional dci 66kw (90cv) euro 6', 'price': 0, 'odometer': 572451, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-10', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 3, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 112, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'cf91c272-01e2-5170-bae2-2980861d41e1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf91c272-01e2-5170-bae2-2980861d41e1/cf91c272-01e2-5170-bae2-2980861d41e1_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 330519}], 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'renault kangoo express', 'sanitized_make': 'renault', 'odometer_in_km': 572451}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 3,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'cf91c272-01e2-5170-bae2-2980861d41e1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo express',
     'model': 'kangoo express',
     'odometer': 572451,
     'odometer_in_km': 572451,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf91c272-01e2-5170-bae2-2980861d41e1/cf91c272-01e2-5170-bae2-2980861d41e1_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 330519,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-05-10',
     'sanitized_make': 'renault',
     'seats_number': 2,
     'seller_name': None,
     'title': 'renault kangoo express profesional dci 66kw (90cv) euro 6',
     'transmission': 'manual',
     'trim': 'profesional dci 66kw (90cv) euro 6',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cf91c272-01e2-5170-bae2-2980861d41e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 572451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf91c272-01e2-5170-bae2-2980861d41e1/cf91c272-01e2-5170-bae2-2980861d41e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/583/da9a1ea961ec4fbfb5b958cc0785ed72/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 66kW (90CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Profesional dCi 66kW (90CV) Euro 6',
 'vin': None,
 'year': 2018}
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878334%27 HTTP/1.1" 200 None
2026-01-28 20:00:41 [ayvens.es] INFO: Saving data for 1878334: {'created_time': 1769630441.350269, 'last_price_update_time': 1769630441.350285, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878334') HTTP/1.1" 204 0
2026-01-28 20:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9948d85c-9a1e-526a-994e-d60d0dd7c502 with identifier: 1878333
2026-01-28 20:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9948d85c-9a1e-526a-994e-d60d0dd7c502 with identifier: 1878333
2026-01-28 20:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9948d85c-9a1e-526a-994e-d60d0dd7c502 with identifier: 1878333 to the API
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/717/560118a233394a13be0a594d0380519b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 77,
 'color': 'Pangea',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9948d85c-9a1e-526a-994e-d60d0dd7c502',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DEFENDER',
 'odometer': 48597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9948d85c-9a1e-526a-994e-d60d0dd7c502/9948d85c-9a1e-526a-994e-d60d0dd7c502_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/717/560118a233394a13be0a594d0380519b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER DEFENDER 2.0 P404E HSE 110 Auto 4WD PHEV',
 'transmission': 'manual',
 'trim': '2.0 P404E HSE 110 Auto 4WD PHEV',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878333%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [ayvens.es] INFO: Saving data for 1878333: {'created_time': 1769630442.504834, 'last_price_update_time': 1769630442.504848, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878333') HTTP/1.1" 204 0
2026-01-28 20:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 327218c4-89d3-5beb-8c84-983263fadbe3 with identifier: 1878336
2026-01-28 20:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 327218c4-89d3-5beb-8c84-983263fadbe3 with identifier: 1878336
2026-01-28 20:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'skoda', 'model': 'karoq', 'trim': '2.0 tdi 110kw (150cv) dsg 4x4 ambition', 'title': 'skoda karoq 2.0 tdi 110kw (150cv) dsg 4x4 ambition', 'price': 0, 'odometer': 222465, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-21', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 147, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '327218c4-89d3-5beb-8c84-983263fadbe3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327218c4-89d3-5beb-8c84-983263fadbe3/327218c4-89d3-5beb-8c84-983263fadbe3_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 318543}], 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'skoda karoq', 'sanitized_make': 'skoda', 'odometer_in_km': 222465}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '327218c4-89d3-5beb-8c84-983263fadbe3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'skoda',
     'make_model': 'skoda karoq',
     'model': 'karoq',
     'odometer': 222465,
     'odometer_in_km': 222465,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327218c4-89d3-5beb-8c84-983263fadbe3/327218c4-89d3-5beb-8c84-983263fadbe3_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 318543,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-21',
     'sanitized_make': 'skoda',
     'seats_number': 5,
     'seller_name': None,
     'title': 'skoda karoq 2.0 tdi 110kw (150cv) dsg 4x4 ambition',
     'transmission': 'manual',
     'trim': '2.0 tdi 110kw (150cv) dsg 4x4 ambition',
     'vin': None,
     'year': 2022}
2026-01-28 20:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 327218c4-89d3-5beb-8c84-983263fadbe3 spider: ayvens.es
2026-01-28 20:00:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 327218c4-89d3-5beb-8c84-983263fadbe3 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'skoda', 'model': 'karoq', 'trim': '2.0 tdi 110kw (150cv) dsg 4x4 ambition', 'title': 'skoda karoq 2.0 tdi 110kw (150cv) dsg 4x4 ambition', 'price': 0, 'odometer': 222465, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-21', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 147, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '327218c4-89d3-5beb-8c84-983263fadbe3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327218c4-89d3-5beb-8c84-983263fadbe3/327218c4-89d3-5beb-8c84-983263fadbe3_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 318543}], 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'skoda karoq', 'sanitized_make': 'skoda', 'odometer_in_km': 222465}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '327218c4-89d3-5beb-8c84-983263fadbe3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'skoda',
     'make_model': 'skoda karoq',
     'model': 'karoq',
     'odometer': 222465,
     'odometer_in_km': 222465,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327218c4-89d3-5beb-8c84-983263fadbe3/327218c4-89d3-5beb-8c84-983263fadbe3_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 318543,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-21',
     'sanitized_make': 'skoda',
     'seats_number': 5,
     'seller_name': None,
     'title': 'skoda karoq 2.0 tdi 110kw (150cv) dsg 4x4 ambition',
     'transmission': 'manual',
     'trim': '2.0 tdi 110kw (150cv) dsg 4x4 ambition',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '327218c4-89d3-5beb-8c84-983263fadbe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 222465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327218c4-89d3-5beb-8c84-983263fadbe3/327218c4-89d3-5beb-8c84-983263fadbe3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/380/6e3599f4011e486bb3dba3905f57fe7a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878336%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [ayvens.es] INFO: Saving data for 1878336: {'created_time': 1769630442.916963, 'last_price_update_time': 1769630442.916976, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878336') HTTP/1.1" 204 0
2026-01-28 20:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab760f32-aee6-585a-b421-5e24bcd993db with identifier: 1878332
2026-01-28 20:00:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab760f32-aee6-585a-b421-5e24bcd993db with identifier: 1878332
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'plata', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'tesla', 'model': 'model y', 'trim': 'traccion trasera rwd', 'title': 'tesla model y traccion trasera rwd', 'price': 0, 'odometer': 57523, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': 0, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ab760f32-aee6-585a-b421-5e24bcd993db', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab760f32-aee6-585a-b421-5e24bcd993db/ab760f32-aee6-585a-b421-5e24bcd993db_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 326240}], 'current_year_diff': 3, 'age_in_months': 29, 'make_model': 'tesla model y', 'sanitized_make': 'tesla', 'odometer_in_km': 57523} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'plata',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'electric',
     'id': 'ab760f32-aee6-585a-b421-5e24bcd993db',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'tesla',
     'make_model': 'tesla model y',
     'model': 'model y',
     'odometer': 57523,
     'odometer_in_km': 57523,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab760f32-aee6-585a-b421-5e24bcd993db/ab760f32-aee6-585a-b421-5e24bcd993db_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 326240,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-08-07',
     'sanitized_make': 'tesla',
     'seats_number': 5,
     'seller_name': None,
     'title': 'tesla model y traccion trasera rwd',
     'transmission': 'manual',
     'trim': 'traccion trasera rwd',
     'vin': None,
     'year': 2023}
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ab760f32-aee6-585a-b421-5e24bcd993db spider: ayvens.es
2026-01-28 20:00:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ab760f32-aee6-585a-b421-5e24bcd993db due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'plata', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'tesla', 'model': 'model y', 'trim': 'traccion trasera rwd', 'title': 'tesla model y traccion trasera rwd', 'price': 0, 'odometer': 57523, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': 0, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ab760f32-aee6-585a-b421-5e24bcd993db', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab760f32-aee6-585a-b421-5e24bcd993db/ab760f32-aee6-585a-b421-5e24bcd993db_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 326240}], 'current_year_diff': 3, 'age_in_months': 29, 'make_model': 'tesla model y', 'sanitized_make': 'tesla', 'odometer_in_km': 57523} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'plata',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'electric',
     'id': 'ab760f32-aee6-585a-b421-5e24bcd993db',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'tesla',
     'make_model': 'tesla model y',
     'model': 'model y',
     'odometer': 57523,
     'odometer_in_km': 57523,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab760f32-aee6-585a-b421-5e24bcd993db/ab760f32-aee6-585a-b421-5e24bcd993db_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 326240,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-08-07',
     'sanitized_make': 'tesla',
     'seats_number': 5,
     'seller_name': None,
     'title': 'tesla model y traccion trasera rwd',
     'transmission': 'manual',
     'trim': 'traccion trasera rwd',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'ab760f32-aee6-585a-b421-5e24bcd993db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 57523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab760f32-aee6-585a-b421-5e24bcd993db/ab760f32-aee6-585a-b421-5e24bcd993db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/549/6e1f74c022d24d74ad4c0eee83a994c3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y Traccion Trasera RWD',
 'transmission': 'manual',
 'trim': 'Traccion Trasera RWD',
 'vin': None,
 'year': 2023}
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878332%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [ayvens.es] INFO: Saving data for 1878332: {'created_time': 1769630443.273374, 'last_price_update_time': 1769630443.273386, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878332') HTTP/1.1" 204 0
2026-01-28 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/016/a7f2fe13f0e746c2acf23c680a00283e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:43 [ayvens.es] INFO: Found listing with ID: 1878354
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878354%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [ayvens.es] INFO: Scrape type for 1878354: 1
2026-01-28 20:00:43 [ayvens.es] INFO: Extracting data for car ID: 1878354
2026-01-28 20:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00427138-533d-5e20-8ba5-919bf1976025 with identifier: 1878354
2026-01-28 20:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00427138-533d-5e20-8ba5-919bf1976025 with scrape type 1
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 00427138-533d-5e20-8ba5-919bf1976025
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F128123f4797d48e3be3fa86b8ce1bc4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/128123f4797d48e3be3fa86b8ce1bc4e/images/large/1.jpg not downloaded yet
2026-01-28 20:00:43 [ayvens.es] INFO: Found listing with ID: 1878355
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878355%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [ayvens.es] INFO: Scrape type for 1878355: 1
2026-01-28 20:00:43 [ayvens.es] INFO: Extracting data for car ID: 1878355
2026-01-28 20:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 225666bf-6412-588c-84a1-94f950bc572c with identifier: 1878355
2026-01-28 20:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 225666bf-6412-588c-84a1-94f950bc572c with scrape type 1
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 225666bf-6412-588c-84a1-94f950bc572c
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F310%252F65e84796fd9844e2a9fa4e2531a2f7d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg not downloaded yet
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9168e50>
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f435f8dc-eeff-54e9-a5fd-cfd4534665b5/f435f8dc-eeff-54e9-a5fd-cfd4534665b5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252F339de64e4f1d4454a645c490c94e3eaa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/339de64e4f1d4454a645c490c94e3eaa/images/large/1.jpg saved to cache
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f435f8dc-eeff-54e9-a5fd-cfd4534665b5
2026-01-28 20:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f435f8dc-eeff-54e9-a5fd-cfd4534665b5, skipping ID generation
2026-01-28 20:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f435f8dc-eeff-54e9-a5fd-cfd4534665b5 with scrape type 1
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f435f8dc-eeff-54e9-a5fd-cfd4534665b5 from tracking dictionaries
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f435f8dc-eeff-54e9-a5fd-cfd4534665b5 sending to next pipeline
2026-01-28 20:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f435f8dc-eeff-54e9-a5fd-cfd4534665b5, identifier: 1878330
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8a83d0>
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d23f3968-bc5e-54b6-a64e-e58a79ffb698/d23f3968-bc5e-54b6-a64e-e58a79ffb698_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252Fdafd5404d7a84b50a5b87c16312f85f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/dafd5404d7a84b50a5b87c16312f85f2/images/large/1.jpg saved to cache
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d23f3968-bc5e-54b6-a64e-e58a79ffb698
2026-01-28 20:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d23f3968-bc5e-54b6-a64e-e58a79ffb698, skipping ID generation
2026-01-28 20:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d23f3968-bc5e-54b6-a64e-e58a79ffb698 with scrape type 1
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d23f3968-bc5e-54b6-a64e-e58a79ffb698 from tracking dictionaries
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d23f3968-bc5e-54b6-a64e-e58a79ffb698 sending to next pipeline
2026-01-28 20:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d23f3968-bc5e-54b6-a64e-e58a79ffb698, identifier: 1878335
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9140850>
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e/fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F358871e2f0cc4cd79937068f6c5f9da7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/358871e2f0cc4cd79937068f6c5f9da7/images/large/1.jpg saved to cache
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e
2026-01-28 20:00:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e, skipping ID generation
2026-01-28 20:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e with scrape type 1
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e from tracking dictionaries
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e sending to next pipeline
2026-01-28 20:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e, identifier: 1878338
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9147790>
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e461514-1912-5108-936c-1bcdc0e9c349/1e461514-1912-5108-936c-1bcdc0e9c349_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F679%252F945cebc9f59c4b43af120ac2c4306048%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/679/945cebc9f59c4b43af120ac2c4306048/images/large/1.jpg saved to cache
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e461514-1912-5108-936c-1bcdc0e9c349
2026-01-28 20:00:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e461514-1912-5108-936c-1bcdc0e9c349, skipping ID generation
2026-01-28 20:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e461514-1912-5108-936c-1bcdc0e9c349 with scrape type 1
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1e461514-1912-5108-936c-1bcdc0e9c349 from tracking dictionaries
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e461514-1912-5108-936c-1bcdc0e9c349 sending to next pipeline
2026-01-28 20:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1e461514-1912-5108-936c-1bcdc0e9c349, identifier: 1878339
2026-01-28 20:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/906/9ee3241e24e2472fa8c6cda093dab726/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:45 [ayvens.es] INFO: Found listing with ID: 1878356
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878356%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [ayvens.es] INFO: Scrape type for 1878356: 1
2026-01-28 20:00:45 [ayvens.es] INFO: Extracting data for car ID: 1878356
2026-01-28 20:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7924489b-3116-5091-a4d1-da7cba232af0 with identifier: 1878356
2026-01-28 20:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7924489b-3116-5091-a4d1-da7cba232af0 with scrape type 1
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7924489b-3116-5091-a4d1-da7cba232af0
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252F21f12709ab424977ae17b2506c34b8fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/21f12709ab424977ae17b2506c34b8fb/images/large/1.jpg not downloaded yet
2026-01-28 20:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f435f8dc-eeff-54e9-a5fd-cfd4534665b5 with identifier: 1878330
2026-01-28 20:00:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f435f8dc-eeff-54e9-a5fd-cfd4534665b5 with identifier: 1878330
2026-01-28 20:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f435f8dc-eeff-54e9-a5fd-cfd4534665b5 with identifier: 1878330 to the API
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/946/339de64e4f1d4454a645c490c94e3eaa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f435f8dc-eeff-54e9-a5fd-cfd4534665b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 115823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f435f8dc-eeff-54e9-a5fd-cfd4534665b5/f435f8dc-eeff-54e9-a5fd-cfd4534665b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/946/339de64e4f1d4454a645c490c94e3eaa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 1.5 TSI 96kW S&S Xcellence',
 'transmission': 'manual',
 'trim': 'SP 1.5 TSI 96kW S&S Xcellence',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878330%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [ayvens.es] INFO: Saving data for 1878330: {'created_time': 1769630446.164941, 'last_price_update_time': 1769630446.164952, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878330') HTTP/1.1" 204 0
2026-01-28 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d23f3968-bc5e-54b6-a64e-e58a79ffb698 with identifier: 1878335
2026-01-28 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d23f3968-bc5e-54b6-a64e-e58a79ffb698 with identifier: 1878335
2026-01-28 20:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d23f3968-bc5e-54b6-a64e-e58a79ffb698 with identifier: 1878335 to the API
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/249/dafd5404d7a84b50a5b87c16312f85f2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd23f3968-bc5e-54b6-a64e-e58a79ffb698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 94183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d23f3968-bc5e-54b6-a64e-e58a79ffb698/d23f3968-bc5e-54b6-a64e-e58a79ffb698_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/249/dafd5404d7a84b50a5b87c16312f85f2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S Comercial',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S Comercial',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878335%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [ayvens.es] INFO: Saving data for 1878335: {'created_time': 1769630447.265651, 'last_price_update_time': 1769630447.265665, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878335') HTTP/1.1" 204 0
2026-01-28 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e with identifier: 1878338
2026-01-28 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e with identifier: 1878338
2026-01-28 20:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e with identifier: 1878338 to the API
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/260/358871e2f0cc4cd79937068f6c5f9da7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'ALFA ROMEO',
 'model': 'STELVIO',
 'odometer': 69464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e/fc005e6a-bdf2-5fa8-bf52-22b3a18bef2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/260/358871e2f0cc4cd79937068f6c5f9da7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'ALFA ROMEO STELVIO 2.2 Diesel 140kW (190CV) Sprint RWD',
 'transmission': 'manual',
 'trim': '2.2 Diesel 140kW (190CV) Sprint RWD',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878338%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [ayvens.es] INFO: Saving data for 1878338: {'created_time': 1769630447.795204, 'last_price_update_time': 1769630447.795215, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878338') HTTP/1.1" 204 0
2026-01-28 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1e461514-1912-5108-936c-1bcdc0e9c349 with identifier: 1878339
2026-01-28 20:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1e461514-1912-5108-936c-1bcdc0e9c349 with identifier: 1878339
2026-01-28 20:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1e461514-1912-5108-936c-1bcdc0e9c349 with identifier: 1878339 to the API
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/679/945cebc9f59c4b43af120ac2c4306048/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1e461514-1912-5108-936c-1bcdc0e9c349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA',
 'odometer': 147779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e461514-1912-5108-936c-1bcdc0e9c349/1e461514-1912-5108-936c-1bcdc0e9c349_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/679/945cebc9f59c4b43af120ac2c4306048/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA 1.6 CDTi 100kW S&S TURBO D Business',
 'transmission': 'manual',
 'trim': '1.6 CDTi 100kW S&S TURBO D Business',
 'vin': None,
 'year': 2017}
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878339%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [ayvens.es] INFO: Saving data for 1878339: {'created_time': 1769630448.170273, 'last_price_update_time': 1769630448.170283, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878339') HTTP/1.1" 204 0
2026-01-28 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/473/c42c084382af4705884508970fdd4391/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/737/4fe7208757084fbabd3ba672093a4dbc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/641/ffea973dc860481daa0df6465f78dba0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:48 [ayvens.es] INFO: Found listing with ID: 1878357
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878357%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [ayvens.es] INFO: Scrape type for 1878357: 1
2026-01-28 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1878357
2026-01-28 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956df3fb-e1b8-5a52-983c-97d964e38259 with identifier: 1878357
2026-01-28 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956df3fb-e1b8-5a52-983c-97d964e38259 with scrape type 1
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 956df3fb-e1b8-5a52-983c-97d964e38259
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252F2e3bf2c886744335a1c8b96dee4850cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/2e3bf2c886744335a1c8b96dee4850cd/images/large/1.jpg not downloaded yet
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9173210>
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e45c1de-623b-51d4-a32d-291853643c11/4e45c1de-623b-51d4-a32d-291853643c11_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F016%252Fa7f2fe13f0e746c2acf23c680a00283e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/016/a7f2fe13f0e746c2acf23c680a00283e/images/large/1.jpg saved to cache
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e45c1de-623b-51d4-a32d-291853643c11
2026-01-28 20:00:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e45c1de-623b-51d4-a32d-291853643c11, skipping ID generation
2026-01-28 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e45c1de-623b-51d4-a32d-291853643c11 with scrape type 1
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4e45c1de-623b-51d4-a32d-291853643c11 from tracking dictionaries
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e45c1de-623b-51d4-a32d-291853643c11 sending to next pipeline
2026-01-28 20:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e45c1de-623b-51d4-a32d-291853643c11, identifier: 1878340
2026-01-28 20:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e45c1de-623b-51d4-a32d-291853643c11 with identifier: 1878340
2026-01-28 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e45c1de-623b-51d4-a32d-291853643c11 with identifier: 1878340
2026-01-28 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169709 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169709
2026-01-28 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4e45c1de-623b-51d4-a32d-291853643c11 spider: ayvens.es
2026-01-28 20:00:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 4e45c1de-623b-51d4-a32d-291853643c11 due to rule: high_mileage_for_country.json, error: 169709 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169709
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4e45c1de-623b-51d4-a32d-291853643c11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 169709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45c1de-623b-51d4-a32d-291853643c11/4e45c1de-623b-51d4-a32d-291853643c11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/016/a7f2fe13f0e746c2acf23c680a00283e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2018}
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878340%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [ayvens.es] INFO: Saving data for 1878340: {'created_time': 1769630448.925325, 'last_price_update_time': 1769630448.925338, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878340') HTTP/1.1" 204 0
2026-01-28 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/364/0ca14fe447fe4815966951cc16b5da95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:48 [ayvens.es] INFO: Found listing with ID: 1878358
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878358%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [ayvens.es] INFO: Scrape type for 1878358: 1
2026-01-28 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1878358
2026-01-28 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 782c6c95-7bd0-50db-8403-754f48c69ae1 with identifier: 1878358
2026-01-28 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 782c6c95-7bd0-50db-8403-754f48c69ae1 with scrape type 1
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 782c6c95-7bd0-50db-8403-754f48c69ae1
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F591%252Fed5f517b5cd641cdbf7316b16e96df9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/591/ed5f517b5cd641cdbf7316b16e96df9d/images/large/1.jpg not downloaded yet
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8f1fd0>
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe46cf59-ca91-5219-ac74-6ae897093590/fe46cf59-ca91-5219-ac74-6ae897093590_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F906%252F9ee3241e24e2472fa8c6cda093dab726%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/906/9ee3241e24e2472fa8c6cda093dab726/images/large/1.jpg saved to cache
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe46cf59-ca91-5219-ac74-6ae897093590
2026-01-28 20:00:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe46cf59-ca91-5219-ac74-6ae897093590, skipping ID generation
2026-01-28 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe46cf59-ca91-5219-ac74-6ae897093590 with scrape type 1
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fe46cf59-ca91-5219-ac74-6ae897093590 from tracking dictionaries
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe46cf59-ca91-5219-ac74-6ae897093590 sending to next pipeline
2026-01-28 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fe46cf59-ca91-5219-ac74-6ae897093590, identifier: 1878341
2026-01-28 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fe46cf59-ca91-5219-ac74-6ae897093590 with identifier: 1878341
2026-01-28 20:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fe46cf59-ca91-5219-ac74-6ae897093590 with identifier: 1878341
2026-01-28 20:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150128 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150128
2026-01-28 20:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fe46cf59-ca91-5219-ac74-6ae897093590 spider: ayvens.es
2026-01-28 20:00:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: fe46cf59-ca91-5219-ac74-6ae897093590 due to rule: high_mileage_for_country.json, error: 150128 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150128
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe46cf59-ca91-5219-ac74-6ae897093590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 150128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe46cf59-ca91-5219-ac74-6ae897093590/fe46cf59-ca91-5219-ac74-6ae897093590_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/906/9ee3241e24e2472fa8c6cda093dab726/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2020}
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878341%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [ayvens.es] INFO: Saving data for 1878341: {'created_time': 1769630449.74507, 'last_price_update_time': 1769630449.74508, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878341') HTTP/1.1" 204 0
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/112/e8d41d366a0c467e90241cd551e5cb22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/128/e5b8d4dda5ff4d2387939b3a3f6ea644/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/983/67dabdfb60b74f3f808007091cc7d545/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:49 [ayvens.es] INFO: Found listing with ID: 1878359
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878359%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [ayvens.es] INFO: Scrape type for 1878359: 1
2026-01-28 20:00:49 [ayvens.es] INFO: Extracting data for car ID: 1878359
2026-01-28 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 745aeeeb-9d5d-5430-9244-a323b97822b8 with identifier: 1878359
2026-01-28 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 745aeeeb-9d5d-5430-9244-a323b97822b8 with scrape type 1
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 745aeeeb-9d5d-5430-9244-a323b97822b8
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252Fd65e654737ce4ae0b00e1e992ee9203d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/d65e654737ce4ae0b00e1e992ee9203d/images/large/1.jpg not downloaded yet
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8defd0>
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301ae193-e20d-5d05-9b74-5d29453e8bfd/301ae193-e20d-5d05-9b74-5d29453e8bfd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F473%252Fc42c084382af4705884508970fdd4391%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/473/c42c084382af4705884508970fdd4391/images/large/1.jpg saved to cache
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 301ae193-e20d-5d05-9b74-5d29453e8bfd
2026-01-28 20:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 301ae193-e20d-5d05-9b74-5d29453e8bfd, skipping ID generation
2026-01-28 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 301ae193-e20d-5d05-9b74-5d29453e8bfd with scrape type 1
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 301ae193-e20d-5d05-9b74-5d29453e8bfd from tracking dictionaries
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 301ae193-e20d-5d05-9b74-5d29453e8bfd sending to next pipeline
2026-01-28 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 301ae193-e20d-5d05-9b74-5d29453e8bfd, identifier: 1878337
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8cdc10>
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6294248e-77fc-5b24-bc87-65b1b4aba35e/6294248e-77fc-5b24-bc87-65b1b4aba35e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F737%252F4fe7208757084fbabd3ba672093a4dbc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/737/4fe7208757084fbabd3ba672093a4dbc/images/large/1.jpg saved to cache
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6294248e-77fc-5b24-bc87-65b1b4aba35e
2026-01-28 20:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6294248e-77fc-5b24-bc87-65b1b4aba35e, skipping ID generation
2026-01-28 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6294248e-77fc-5b24-bc87-65b1b4aba35e with scrape type 1
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6294248e-77fc-5b24-bc87-65b1b4aba35e from tracking dictionaries
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6294248e-77fc-5b24-bc87-65b1b4aba35e sending to next pipeline
2026-01-28 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6294248e-77fc-5b24-bc87-65b1b4aba35e, identifier: 1878343
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9145610>
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd81ecf7-cb09-5ee4-8751-5967a15fec77/dd81ecf7-cb09-5ee4-8751-5967a15fec77_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F641%252Fffea973dc860481daa0df6465f78dba0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/641/ffea973dc860481daa0df6465f78dba0/images/large/1.jpg saved to cache
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd81ecf7-cb09-5ee4-8751-5967a15fec77
2026-01-28 20:00:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd81ecf7-cb09-5ee4-8751-5967a15fec77, skipping ID generation
2026-01-28 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd81ecf7-cb09-5ee4-8751-5967a15fec77 with scrape type 1
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dd81ecf7-cb09-5ee4-8751-5967a15fec77 from tracking dictionaries
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd81ecf7-cb09-5ee4-8751-5967a15fec77 sending to next pipeline
2026-01-28 20:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dd81ecf7-cb09-5ee4-8751-5967a15fec77, identifier: 1878344
2026-01-28 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 301ae193-e20d-5d05-9b74-5d29453e8bfd with identifier: 1878337
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 301ae193-e20d-5d05-9b74-5d29453e8bfd with identifier: 1878337
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 301ae193-e20d-5d05-9b74-5d29453e8bfd spider: ayvens.es
2026-01-28 20:00:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 301ae193-e20d-5d05-9b74-5d29453e8bfd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '301ae193-e20d-5d05-9b74-5d29453e8bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 122982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301ae193-e20d-5d05-9b74-5d29453e8bfd/301ae193-e20d-5d05-9b74-5d29453e8bfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/473/c42c084382af4705884508970fdd4391/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878337%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.es] INFO: Saving data for 1878337: {'created_time': 1769630451.550637, 'last_price_update_time': 1769630451.550647, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878337') HTTP/1.1" 204 0
2026-01-28 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6294248e-77fc-5b24-bc87-65b1b4aba35e with identifier: 1878343
2026-01-28 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6294248e-77fc-5b24-bc87-65b1b4aba35e with identifier: 1878343
2026-01-28 20:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6294248e-77fc-5b24-bc87-65b1b4aba35e with identifier: 1878343 to the API
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/737/4fe7208757084fbabd3ba672093a4dbc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Verde',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6294248e-77fc-5b24-bc87-65b1b4aba35e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 57808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6294248e-77fc-5b24-bc87-65b1b4aba35e/6294248e-77fc-5b24-bc87-65b1b4aba35e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/737/4fe7208757084fbabd3ba672093a4dbc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878343%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.es] INFO: Saving data for 1878343: {'created_time': 1769630451.906379, 'last_price_update_time': 1769630451.906391, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878343') HTTP/1.1" 204 0
2026-01-28 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dd81ecf7-cb09-5ee4-8751-5967a15fec77 with identifier: 1878344
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dd81ecf7-cb09-5ee4-8751-5967a15fec77 with identifier: 1878344
2026-01-28 20:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: dd81ecf7-cb09-5ee4-8751-5967a15fec77 spider: ayvens.es
2026-01-28 20:00:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: dd81ecf7-cb09-5ee4-8751-5967a15fec77 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dd81ecf7-cb09-5ee4-8751-5967a15fec77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 78837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd81ecf7-cb09-5ee4-8751-5967a15fec77/dd81ecf7-cb09-5ee4-8751-5967a15fec77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/641/ffea973dc860481daa0df6465f78dba0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 LIVE',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 LIVE',
 'vin': None,
 'year': 2019}
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878344%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.es] INFO: Saving data for 1878344: {'created_time': 1769630452.165283, 'last_price_update_time': 1769630452.165293, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878344') HTTP/1.1" 204 0
2026-01-28 20:00:52 [ayvens.es] INFO: Found listing with ID: 1878360
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878360%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.es] INFO: Scrape type for 1878360: 1
2026-01-28 20:00:52 [ayvens.es] INFO: Extracting data for car ID: 1878360
2026-01-28 20:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d677d61d-a331-5c20-8176-0e1336ba12ea with identifier: 1878360
2026-01-28 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d677d61d-a331-5c20-8176-0e1336ba12ea with scrape type 1
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d677d61d-a331-5c20-8176-0e1336ba12ea
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252F7953a90116174ae983e48b6fc5d241fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/7953a90116174ae983e48b6fc5d241fd/images/large/1.jpg not downloaded yet
2026-01-28 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/204/b11157ee51874535a0ec5d3435d823a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91056d0>
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7987af9-e544-5867-ae0b-53b74a621c0b/a7987af9-e544-5867-ae0b-53b74a621c0b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F364%252F0ca14fe447fe4815966951cc16b5da95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/364/0ca14fe447fe4815966951cc16b5da95/images/large/1.jpg saved to cache
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7987af9-e544-5867-ae0b-53b74a621c0b
2026-01-28 20:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7987af9-e544-5867-ae0b-53b74a621c0b, skipping ID generation
2026-01-28 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7987af9-e544-5867-ae0b-53b74a621c0b with scrape type 1
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7987af9-e544-5867-ae0b-53b74a621c0b from tracking dictionaries
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7987af9-e544-5867-ae0b-53b74a621c0b sending to next pipeline
2026-01-28 20:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a7987af9-e544-5867-ae0b-53b74a621c0b, identifier: 1878342
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c90f2f10>
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f9f99e-6cd1-5b81-b528-1312f88eb4a0/90f9f99e-6cd1-5b81-b528-1312f88eb4a0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252Fe8d41d366a0c467e90241cd551e5cb22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/e8d41d366a0c467e90241cd551e5cb22/images/large/1.jpg saved to cache
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90f9f99e-6cd1-5b81-b528-1312f88eb4a0
2026-01-28 20:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90f9f99e-6cd1-5b81-b528-1312f88eb4a0, skipping ID generation
2026-01-28 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 with scrape type 1
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 from tracking dictionaries
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 sending to next pipeline
2026-01-28 20:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 90f9f99e-6cd1-5b81-b528-1312f88eb4a0, identifier: 1878345
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca9e5d50>
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7019ce51-fafa-5672-895d-5adc1d6fa8da/7019ce51-fafa-5672-895d-5adc1d6fa8da_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252Fe5b8d4dda5ff4d2387939b3a3f6ea644%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/e5b8d4dda5ff4d2387939b3a3f6ea644/images/large/1.jpg saved to cache
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7019ce51-fafa-5672-895d-5adc1d6fa8da
2026-01-28 20:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7019ce51-fafa-5672-895d-5adc1d6fa8da, skipping ID generation
2026-01-28 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7019ce51-fafa-5672-895d-5adc1d6fa8da with scrape type 1
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7019ce51-fafa-5672-895d-5adc1d6fa8da from tracking dictionaries
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7019ce51-fafa-5672-895d-5adc1d6fa8da sending to next pipeline
2026-01-28 20:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7019ce51-fafa-5672-895d-5adc1d6fa8da, identifier: 1878346
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca9defd0>
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c4ade9-9346-5005-8e03-193e32636ff4/e1c4ade9-9346-5005-8e03-193e32636ff4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F983%252F67dabdfb60b74f3f808007091cc7d545%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/983/67dabdfb60b74f3f808007091cc7d545/images/large/1.jpg saved to cache
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1c4ade9-9346-5005-8e03-193e32636ff4
2026-01-28 20:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1c4ade9-9346-5005-8e03-193e32636ff4, skipping ID generation
2026-01-28 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c4ade9-9346-5005-8e03-193e32636ff4 with scrape type 1
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1c4ade9-9346-5005-8e03-193e32636ff4 from tracking dictionaries
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1c4ade9-9346-5005-8e03-193e32636ff4 sending to next pipeline
2026-01-28 20:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e1c4ade9-9346-5005-8e03-193e32636ff4, identifier: 1878347
2026-01-28 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/701/1a095a5db6664fccb863dd1fa3a0cbee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:54 [ayvens.es] INFO: Found listing with ID: 1878361
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878361%27 HTTP/1.1" 200 None
2026-01-28 20:00:54 [ayvens.es] INFO: Scrape type for 1878361: 1
2026-01-28 20:00:54 [ayvens.es] INFO: Extracting data for car ID: 1878361
2026-01-28 20:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d6e8af-8b0f-5e6b-b57e-a66367260b62 with identifier: 1878361
2026-01-28 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d6e8af-8b0f-5e6b-b57e-a66367260b62 with scrape type 1
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6d6e8af-8b0f-5e6b-b57e-a66367260b62
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F393%252F1c886439098343b9b848c66a2fbb7e40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg not downloaded yet
2026-01-28 20:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a7987af9-e544-5867-ae0b-53b74a621c0b with identifier: 1878342
2026-01-28 20:00:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a7987af9-e544-5867-ae0b-53b74a621c0b with identifier: 1878342
2026-01-28 20:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a7987af9-e544-5867-ae0b-53b74a621c0b with identifier: 1878342 to the API
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/364/0ca14fe447fe4815966951cc16b5da95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a7987af9-e544-5867-ae0b-53b74a621c0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 74873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7987af9-e544-5867-ae0b-53b74a621c0b/a7987af9-e544-5867-ae0b-53b74a621c0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/364/0ca14fe447fe4815966951cc16b5da95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878342%27 HTTP/1.1" 200 None
2026-01-28 20:00:54 [ayvens.es] INFO: Saving data for 1878342: {'created_time': 1769630454.99513, 'last_price_update_time': 1769630454.995143, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878342') HTTP/1.1" 204 0
2026-01-28 20:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 with identifier: 1878345
2026-01-28 20:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 with identifier: 1878345
2026-01-28 20:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 90f9f99e-6cd1-5b81-b528-1312f88eb4a0 with identifier: 1878345 to the API
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/112/e8d41d366a0c467e90241cd551e5cb22/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '90f9f99e-6cd1-5b81-b528-1312f88eb4a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 98632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f9f99e-6cd1-5b81-b528-1312f88eb4a0/90f9f99e-6cd1-5b81-b528-1312f88eb4a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/112/e8d41d366a0c467e90241cd551e5cb22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Variant Executive 2.0 TDI 110kW DSG',
 'transmission': 'manual',
 'trim': 'Variant Executive 2.0 TDI 110kW DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878345%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.es] INFO: Saving data for 1878345: {'created_time': 1769630455.382776, 'last_price_update_time': 1769630455.382788, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878345') HTTP/1.1" 204 0
2026-01-28 20:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7019ce51-fafa-5672-895d-5adc1d6fa8da with identifier: 1878346
2026-01-28 20:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7019ce51-fafa-5672-895d-5adc1d6fa8da with identifier: 1878346
2026-01-28 20:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-28 20:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7019ce51-fafa-5672-895d-5adc1d6fa8da spider: ayvens.es
2026-01-28 20:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7019ce51-fafa-5672-895d-5adc1d6fa8da due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7019ce51-fafa-5672-895d-5adc1d6fa8da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 193502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7019ce51-fafa-5672-895d-5adc1d6fa8da/7019ce51-fafa-5672-895d-5adc1d6fa8da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/128/e5b8d4dda5ff4d2387939b3a3f6ea644/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878346%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.es] INFO: Saving data for 1878346: {'created_time': 1769630455.62044, 'last_price_update_time': 1769630455.620454, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878346') HTTP/1.1" 204 0
2026-01-28 20:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e1c4ade9-9346-5005-8e03-193e32636ff4 with identifier: 1878347
2026-01-28 20:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e1c4ade9-9346-5005-8e03-193e32636ff4 with identifier: 1878347
2026-01-28 20:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e1c4ade9-9346-5005-8e03-193e32636ff4 with identifier: 1878347 to the API
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/983/67dabdfb60b74f3f808007091cc7d545/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e1c4ade9-9346-5005-8e03-193e32636ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 90346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1c4ade9-9346-5005-8e03-193e32636ff4/e1c4ade9-9346-5005-8e03-193e32636ff4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/983/67dabdfb60b74f3f808007091cc7d545/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18dA Corporate',
 'transmission': 'manual',
 'trim': 'sDrive18dA Corporate',
 'vin': None,
 'year': 2022}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878347%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.es] INFO: Saving data for 1878347: {'created_time': 1769630455.959926, 'last_price_update_time': 1769630455.959935, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878347') HTTP/1.1" 204 0
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/999/98323eec9e604cac9612c432ac97c040/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/ee05bdc18b694059b888e5bae71e59e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:55 [ayvens.es] INFO: Found listing with ID: 1878362
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878362%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.es] INFO: Scrape type for 1878362: 1
2026-01-28 20:00:56 [ayvens.es] INFO: Extracting data for car ID: 1878362
2026-01-28 20:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fa93987-ff5e-530f-a4c0-8724c19efa41 with identifier: 1878362
2026-01-28 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fa93987-ff5e-530f-a4c0-8724c19efa41 with scrape type 1
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3fa93987-ff5e-530f-a4c0-8724c19efa41
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F271%252Fc78f9d7d285f4cf2a9fd136eda9cfb96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/271/c78f9d7d285f4cf2a9fd136eda9cfb96/images/large/1.jpg not downloaded yet
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/638/128123f4797d48e3be3fa86b8ce1bc4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca841250>
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f134a-2126-5bb1-a424-8696b3eefb2c/435f134a-2126-5bb1-a424-8696b3eefb2c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252Fb11157ee51874535a0ec5d3435d823a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/b11157ee51874535a0ec5d3435d823a9/images/large/1.jpg saved to cache
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 435f134a-2126-5bb1-a424-8696b3eefb2c
2026-01-28 20:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 435f134a-2126-5bb1-a424-8696b3eefb2c, skipping ID generation
2026-01-28 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 435f134a-2126-5bb1-a424-8696b3eefb2c with scrape type 1
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 435f134a-2126-5bb1-a424-8696b3eefb2c from tracking dictionaries
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 435f134a-2126-5bb1-a424-8696b3eefb2c sending to next pipeline
2026-01-28 20:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 435f134a-2126-5bb1-a424-8696b3eefb2c, identifier: 1878351
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca859510>
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293a78a6-cbc9-589e-bcff-0cb3fe0788b0/293a78a6-cbc9-589e-bcff-0cb3fe0788b0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F701%252F1a095a5db6664fccb863dd1fa3a0cbee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/701/1a095a5db6664fccb863dd1fa3a0cbee/images/large/1.jpg saved to cache
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 293a78a6-cbc9-589e-bcff-0cb3fe0788b0
2026-01-28 20:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 293a78a6-cbc9-589e-bcff-0cb3fe0788b0, skipping ID generation
2026-01-28 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 with scrape type 1
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 from tracking dictionaries
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 sending to next pipeline
2026-01-28 20:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 293a78a6-cbc9-589e-bcff-0cb3fe0788b0, identifier: 1878349
2026-01-28 20:00:56 [ayvens.es] INFO: Found listing with ID: 1878363
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878363%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.es] INFO: Scrape type for 1878363: 1
2026-01-28 20:00:56 [ayvens.es] INFO: Extracting data for car ID: 1878363
2026-01-28 20:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfa0a8da-08e5-5e74-a864-15e3ad4133cc with identifier: 1878363
2026-01-28 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfa0a8da-08e5-5e74-a864-15e3ad4133cc with scrape type 1
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cfa0a8da-08e5-5e74-a864-15e3ad4133cc
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F741%252Fad307dc1d3584e1b98f4e1925223ad53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/741/ad307dc1d3584e1b98f4e1925223ad53/images/large/1.jpg not downloaded yet
2026-01-28 20:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 435f134a-2126-5bb1-a424-8696b3eefb2c with identifier: 1878351
2026-01-28 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 435f134a-2126-5bb1-a424-8696b3eefb2c with identifier: 1878351
2026-01-28 20:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 435f134a-2126-5bb1-a424-8696b3eefb2c with identifier: 1878351 to the API
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/204/b11157ee51874535a0ec5d3435d823a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '435f134a-2126-5bb1-a424-8696b3eefb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 32560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f134a-2126-5bb1-a424-8696b3eefb2c/435f134a-2126-5bb1-a424-8696b3eefb2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/204/b11157ee51874535a0ec5d3435d823a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Essential Blue dCi 85kW (115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Essential Blue dCi 85kW (115CV) 4X4',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878351%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.es] INFO: Saving data for 1878351: {'created_time': 1769630457.349022, 'last_price_update_time': 1769630457.349032, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878351') HTTP/1.1" 204 0
2026-01-28 20:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 with identifier: 1878349
2026-01-28 20:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 with identifier: 1878349
2026-01-28 20:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 293a78a6-cbc9-589e-bcff-0cb3fe0788b0 with identifier: 1878349 to the API
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/701/1a095a5db6664fccb863dd1fa3a0cbee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Color',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '293a78a6-cbc9-589e-bcff-0cb3fe0788b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 69310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293a78a6-cbc9-589e-bcff-0cb3fe0788b0/293a78a6-cbc9-589e-bcff-0cb3fe0788b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/701/1a095a5db6664fccb863dd1fa3a0cbee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive20dA',
 'transmission': 'manual',
 'trim': 'sDrive20dA',
 'vin': None,
 'year': 2020}
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878349%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [ayvens.es] INFO: Saving data for 1878349: {'created_time': 1769630458.480511, 'last_price_update_time': 1769630458.480523, 'auction_closing_time': 1769688000.0}
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878349') HTTP/1.1" 204 0
2026-01-28 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/955/094dc33bbf434cdebf51632cc59e6de6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:58 [ayvens.es] INFO: Found listing with ID: 1878364
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878364%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [ayvens.es] INFO: Scrape type for 1878364: 1
2026-01-28 20:00:58 [ayvens.es] INFO: Extracting data for car ID: 1878364
2026-01-28 20:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 with identifier: 1878364
2026-01-28 20:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 with scrape type 1
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 029275cb-1a4b-5f6a-af2e-ab1b82f8be98
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F949%252F03d27e2d5f85463c9357e0e682e23991%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/949/03d27e2d5f85463c9357e0e682e23991/images/large/1.jpg not downloaded yet
2026-01-28 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/824/21f12709ab424977ae17b2506c34b8fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca842b90>
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09aaac4a-181c-5eb0-bcf9-76b869648e27/09aaac4a-181c-5eb0-bcf9-76b869648e27_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F999%252F98323eec9e604cac9612c432ac97c040%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/999/98323eec9e604cac9612c432ac97c040/images/large/1.jpg saved to cache
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09aaac4a-181c-5eb0-bcf9-76b869648e27
2026-01-28 20:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09aaac4a-181c-5eb0-bcf9-76b869648e27, skipping ID generation
2026-01-28 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09aaac4a-181c-5eb0-bcf9-76b869648e27 with scrape type 1
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 09aaac4a-181c-5eb0-bcf9-76b869648e27 from tracking dictionaries
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09aaac4a-181c-5eb0-bcf9-76b869648e27 sending to next pipeline
2026-01-28 20:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 09aaac4a-181c-5eb0-bcf9-76b869648e27, identifier: 1878348
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca204e90>
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23abeee0-13e7-52bf-a92c-f4f9800b09db/23abeee0-13e7-52bf-a92c-f4f9800b09db_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252Fee05bdc18b694059b888e5bae71e59e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/ee05bdc18b694059b888e5bae71e59e3/images/large/1.jpg saved to cache
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23abeee0-13e7-52bf-a92c-f4f9800b09db
2026-01-28 20:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23abeee0-13e7-52bf-a92c-f4f9800b09db, skipping ID generation
2026-01-28 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23abeee0-13e7-52bf-a92c-f4f9800b09db with scrape type 1
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 23abeee0-13e7-52bf-a92c-f4f9800b09db from tracking dictionaries
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23abeee0-13e7-52bf-a92c-f4f9800b09db sending to next pipeline
2026-01-28 20:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23abeee0-13e7-52bf-a92c-f4f9800b09db, identifier: 1878350
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fe1150>
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7532722b-64e4-5dd3-948e-67d144a7de8e/7532722b-64e4-5dd3-948e-67d144a7de8e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F787%252F95ffe0aafbb24d5684babda47f8c2bb4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg saved to cache
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7532722b-64e4-5dd3-948e-67d144a7de8e
2026-01-28 20:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7532722b-64e4-5dd3-948e-67d144a7de8e, skipping ID generation
2026-01-28 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7532722b-64e4-5dd3-948e-67d144a7de8e with scrape type 1
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7532722b-64e4-5dd3-948e-67d144a7de8e from tracking dictionaries
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7532722b-64e4-5dd3-948e-67d144a7de8e sending to next pipeline
2026-01-28 20:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7532722b-64e4-5dd3-948e-67d144a7de8e, identifier: 1878352
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca285050>
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_225666bf-6412-588c-84a1-94f950bc572c/225666bf-6412-588c-84a1-94f950bc572c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F310%252F65e84796fd9844e2a9fa4e2531a2f7d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg saved to cache
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 225666bf-6412-588c-84a1-94f950bc572c
2026-01-28 20:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 225666bf-6412-588c-84a1-94f950bc572c, skipping ID generation
2026-01-28 20:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 225666bf-6412-588c-84a1-94f950bc572c with scrape type 1
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 225666bf-6412-588c-84a1-94f950bc572c from tracking dictionaries
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 225666bf-6412-588c-84a1-94f950bc572c sending to next pipeline
2026-01-28 20:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 225666bf-6412-588c-84a1-94f950bc572c, identifier: 1878355
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca24df50>
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00427138-533d-5e20-8ba5-919bf1976025/00427138-533d-5e20-8ba5-919bf1976025_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F128123f4797d48e3be3fa86b8ce1bc4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/128123f4797d48e3be3fa86b8ce1bc4e/images/large/1.jpg saved to cache
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00427138-533d-5e20-8ba5-919bf1976025
2026-01-28 20:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00427138-533d-5e20-8ba5-919bf1976025, skipping ID generation
2026-01-28 20:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00427138-533d-5e20-8ba5-919bf1976025 with scrape type 1
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 00427138-533d-5e20-8ba5-919bf1976025 from tracking dictionaries
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00427138-533d-5e20-8ba5-919bf1976025 sending to next pipeline
2026-01-28 20:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 00427138-533d-5e20-8ba5-919bf1976025, identifier: 1878354
2026-01-28 20:01:00 [ayvens.es] INFO: Found listing with ID: 1878365
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878365%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [ayvens.es] INFO: Scrape type for 1878365: 1
2026-01-28 20:01:00 [ayvens.es] INFO: Extracting data for car ID: 1878365
2026-01-28 20:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 604c0046-4036-5ce6-b192-b0957d3f2e07 with identifier: 1878365
2026-01-28 20:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 604c0046-4036-5ce6-b192-b0957d3f2e07 with scrape type 1
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 604c0046-4036-5ce6-b192-b0957d3f2e07
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F346%252F099021c8202f47a584edfda2525ad2c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg not downloaded yet
2026-01-28 20:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 09aaac4a-181c-5eb0-bcf9-76b869648e27 with identifier: 1878348
2026-01-28 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 09aaac4a-181c-5eb0-bcf9-76b869648e27 with identifier: 1878348
2026-01-28 20:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 09aaac4a-181c-5eb0-bcf9-76b869648e27 with identifier: 1878348 to the API
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/999/98323eec9e604cac9612c432ac97c040/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '09aaac4a-181c-5eb0-bcf9-76b869648e27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 145824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09aaac4a-181c-5eb0-bcf9-76b869648e27/09aaac4a-181c-5eb0-bcf9-76b869648e27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/999/98323eec9e604cac9612c432ac97c040/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance Style 2.0 TDI 110kW DSG',
 'transmission': 'manual',
 'trim': 'Advance Style 2.0 TDI 110kW DSG',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878348%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.es] INFO: Saving data for 1878348: {'created_time': 1769630461.292925, 'last_price_update_time': 1769630461.292937, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878348') HTTP/1.1" 204 0
2026-01-28 20:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23abeee0-13e7-52bf-a92c-f4f9800b09db with identifier: 1878350
2026-01-28 20:01:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23abeee0-13e7-52bf-a92c-f4f9800b09db with identifier: 1878350
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 23abeee0-13e7-52bf-a92c-f4f9800b09db spider: ayvens.es
2026-01-28 20:01:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 23abeee0-13e7-52bf-a92c-f4f9800b09db due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '23abeee0-13e7-52bf-a92c-f4f9800b09db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 60623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23abeee0-13e7-52bf-a92c-f4f9800b09db/23abeee0-13e7-52bf-a92c-f4f9800b09db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/ee05bdc18b694059b888e5bae71e59e3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Maxi 2p dCi 66 kW (90 CV',
 'transmission': 'manual',
 'trim': '(O) Profesional Maxi 2p dCi 66 kW (90 CV',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878350%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.es] INFO: Saving data for 1878350: {'created_time': 1769630461.547478, 'last_price_update_time': 1769630461.547491, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878350') HTTP/1.1" 204 0
2026-01-28 20:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7532722b-64e4-5dd3-948e-67d144a7de8e with identifier: 1878352
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7532722b-64e4-5dd3-948e-67d144a7de8e with identifier: 1878352
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'toyota', 'model': 'proace verso', 'trim': 'combi compact 1.6d 115 cv 9p', 'title': 'toyota proace verso combi compact 1.6d 115 cv 9p', 'price': 0, 'odometer': 360819, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-24', 'year': 2017, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 9, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 137, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7532722b-64e4-5dd3-948e-67d144a7de8e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7532722b-64e4-5dd3-948e-67d144a7de8e/7532722b-64e4-5dd3-948e-67d144a7de8e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 325148}], 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'toyota proace verso', 'sanitized_make': 'toyota', 'odometer_in_km': 360819}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 137,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 4,
     'engine': '1.6l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7532722b-64e4-5dd3-948e-67d144a7de8e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'toyota',
     'make_model': 'toyota proace verso',
     'model': 'proace verso',
     'odometer': 360819,
     'odometer_in_km': 360819,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7532722b-64e4-5dd3-948e-67d144a7de8e/7532722b-64e4-5dd3-948e-67d144a7de8e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 325148,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-10-24',
     'sanitized_make': 'toyota',
     'seats_number': 9,
     'seller_name': None,
     'title': 'toyota proace verso combi compact 1.6d 115 cv 9p',
     'transmission': 'manual',
     'trim': 'combi compact 1.6d 115 cv 9p',
     'vin': None,
     'year': 2017}
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 7532722b-64e4-5dd3-948e-67d144a7de8e spider: ayvens.es
2026-01-28 20:01:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7532722b-64e4-5dd3-948e-67d144a7de8e due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'toyota', 'model': 'proace verso', 'trim': 'combi compact 1.6d 115 cv 9p', 'title': 'toyota proace verso combi compact 1.6d 115 cv 9p', 'price': 0, 'odometer': 360819, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-24', 'year': 2017, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 9, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 137, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7532722b-64e4-5dd3-948e-67d144a7de8e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7532722b-64e4-5dd3-948e-67d144a7de8e/7532722b-64e4-5dd3-948e-67d144a7de8e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 325148}], 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'toyota proace verso', 'sanitized_make': 'toyota', 'odometer_in_km': 360819}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 137,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 4,
     'engine': '1.6l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7532722b-64e4-5dd3-948e-67d144a7de8e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'toyota',
     'make_model': 'toyota proace verso',
     'model': 'proace verso',
     'odometer': 360819,
     'odometer_in_km': 360819,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7532722b-64e4-5dd3-948e-67d144a7de8e/7532722b-64e4-5dd3-948e-67d144a7de8e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 325148,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-10-24',
     'sanitized_make': 'toyota',
     'seats_number': 9,
     'seller_name': None,
     'title': 'toyota proace verso combi compact 1.6d 115 cv 9p',
     'transmission': 'manual',
     'trim': 'combi compact 1.6d 115 cv 9p',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7532722b-64e4-5dd3-948e-67d144a7de8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE VERSO',
 'odometer': 360819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7532722b-64e4-5dd3-948e-67d144a7de8e/7532722b-64e4-5dd3-948e-67d144a7de8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/787/95ffe0aafbb24d5684babda47f8c2bb4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seats_number': 9,
 'seller_name': None,
 'title': 'TOYOTA PROACE VERSO COMBI COMPACT 1.6D 115 CV 9P',
 'transmission': 'manual',
 'trim': 'COMBI COMPACT 1.6D 115 CV 9P',
 'vin': None,
 'year': 2017}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878352%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.es] INFO: Saving data for 1878352: {'created_time': 1769630461.794348, 'last_price_update_time': 1769630461.794358, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878352') HTTP/1.1" 204 0
2026-01-28 20:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 225666bf-6412-588c-84a1-94f950bc572c with identifier: 1878355
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 225666bf-6412-588c-84a1-94f950bc572c with identifier: 1878355
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'fiat', 'model': 'ducato', 'trim': '30 l1 h1 2.3 1 (103 kw) euro 6d-temp', 'title': 'fiat ducato 30 l1 h1 2.3 1 (103 kw) euro 6d-temp', 'price': 0, 'odometer': 213772, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-25', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 3, 'vin': None, 'license_plate': None, 'engine': '2.3l', 'c_o_2_emission_value': 186, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '225666bf-6412-588c-84a1-94f950bc572c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_225666bf-6412-588c-84a1-94f950bc572c/225666bf-6412-588c-84a1-94f950bc572c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 307691}], 'current_year_diff': 6, 'age_in_months': 68, 'make_model': 'fiat ducato', 'sanitized_make': 'fiat', 'odometer_in_km': 213772}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 68,
     'auction_title': '',
     'c_o_2_emission_value': 186,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '2.3l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '225666bf-6412-588c-84a1-94f950bc572c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'fiat',
     'make_model': 'fiat ducato',
     'model': 'ducato',
     'odometer': 213772,
     'odometer_in_km': 213772,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_225666bf-6412-588c-84a1-94f950bc572c/225666bf-6412-588c-84a1-94f950bc572c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 307691,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-05-25',
     'sanitized_make': 'fiat',
     'seats_number': 3,
     'seller_name': None,
     'title': 'fiat ducato 30 l1 h1 2.3 1 (103 kw) euro 6d-temp',
     'transmission': 'manual',
     'trim': '30 l1 h1 2.3 1 (103 kw) euro 6d-temp',
     'vin': None,
     'year': 2020}
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 225666bf-6412-588c-84a1-94f950bc572c spider: ayvens.es
2026-01-28 20:01:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 225666bf-6412-588c-84a1-94f950bc572c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'fiat', 'model': 'ducato', 'trim': '30 l1 h1 2.3 1 (103 kw) euro 6d-temp', 'title': 'fiat ducato 30 l1 h1 2.3 1 (103 kw) euro 6d-temp', 'price': 0, 'odometer': 213772, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-25', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 3, 'vin': None, 'license_plate': None, 'engine': '2.3l', 'c_o_2_emission_value': 186, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '225666bf-6412-588c-84a1-94f950bc572c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_225666bf-6412-588c-84a1-94f950bc572c/225666bf-6412-588c-84a1-94f950bc572c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 307691}], 'current_year_diff': 6, 'age_in_months': 68, 'make_model': 'fiat ducato', 'sanitized_make': 'fiat', 'odometer_in_km': 213772}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 68,
     'auction_title': '',
     'c_o_2_emission_value': 186,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '2.3l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '225666bf-6412-588c-84a1-94f950bc572c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'fiat',
     'make_model': 'fiat ducato',
     'model': 'ducato',
     'odometer': 213772,
     'odometer_in_km': 213772,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_225666bf-6412-588c-84a1-94f950bc572c/225666bf-6412-588c-84a1-94f950bc572c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 307691,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-05-25',
     'sanitized_make': 'fiat',
     'seats_number': 3,
     'seller_name': None,
     'title': 'fiat ducato 30 l1 h1 2.3 1 (103 kw) euro 6d-temp',
     'transmission': 'manual',
     'trim': '30 l1 h1 2.3 1 (103 kw) euro 6d-temp',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '225666bf-6412-588c-84a1-94f950bc572c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO',
 'odometer': 213772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_225666bf-6412-588c-84a1-94f950bc572c/225666bf-6412-588c-84a1-94f950bc572c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/310/65e84796fd9844e2a9fa4e2531a2f7d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FIAT DUCATO 30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'transmission': 'manual',
 'trim': '30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878355%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.es] INFO: Saving data for 1878355: {'created_time': 1769630462.02882, 'last_price_update_time': 1769630462.028831, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878355') HTTP/1.1" 204 0
2026-01-28 20:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 00427138-533d-5e20-8ba5-919bf1976025 with identifier: 1878354
2026-01-28 20:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 00427138-533d-5e20-8ba5-919bf1976025 with identifier: 1878354
2026-01-28 20:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-28 20:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 00427138-533d-5e20-8ba5-919bf1976025 spider: ayvens.es
2026-01-28 20:01:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 00427138-533d-5e20-8ba5-919bf1976025 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '00427138-533d-5e20-8ba5-919bf1976025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 31685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00427138-533d-5e20-8ba5-919bf1976025/00427138-533d-5e20-8ba5-919bf1976025_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/638/128123f4797d48e3be3fa86b8ce1bc4e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 90KW (122CV) Club',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 90KW (122CV) Club',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878354%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.es] INFO: Saving data for 1878354: {'created_time': 1769630462.27752, 'last_price_update_time': 1769630462.277529, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878354') HTTP/1.1" 204 0
2026-01-28 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/359/7953a90116174ae983e48b6fc5d241fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/495/d65e654737ce4ae0b00e1e992ee9203d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:02 [ayvens.es] INFO: Found listing with ID: 1878366
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878366%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.es] INFO: Scrape type for 1878366: 1
2026-01-28 20:01:02 [ayvens.es] INFO: Extracting data for car ID: 1878366
2026-01-28 20:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a3876a-e14c-5e36-a1c8-d869367da449 with identifier: 1878366
2026-01-28 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a3876a-e14c-5e36-a1c8-d869367da449 with scrape type 1
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08a3876a-e14c-5e36-a1c8-d869367da449
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F297%252F0a64f371f07b488db29cfdf0c5d80e6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/297/0a64f371f07b488db29cfdf0c5d80e6d/images/large/1.jpg not downloaded yet
2026-01-28 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/210/2e3bf2c886744335a1c8b96dee4850cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c916a310>
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1542ef6-906a-50f6-aa95-0ba5498e4d07/a1542ef6-906a-50f6-aa95-0ba5498e4d07_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F094dc33bbf434cdebf51632cc59e6de6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/094dc33bbf434cdebf51632cc59e6de6/images/large/1.jpg saved to cache
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1542ef6-906a-50f6-aa95-0ba5498e4d07
2026-01-28 20:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1542ef6-906a-50f6-aa95-0ba5498e4d07, skipping ID generation
2026-01-28 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1542ef6-906a-50f6-aa95-0ba5498e4d07 with scrape type 1
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1542ef6-906a-50f6-aa95-0ba5498e4d07 from tracking dictionaries
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1542ef6-906a-50f6-aa95-0ba5498e4d07 sending to next pipeline
2026-01-28 20:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a1542ef6-906a-50f6-aa95-0ba5498e4d07, identifier: 1878353
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca664290>
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7924489b-3116-5091-a4d1-da7cba232af0/7924489b-3116-5091-a4d1-da7cba232af0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252F21f12709ab424977ae17b2506c34b8fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/21f12709ab424977ae17b2506c34b8fb/images/large/1.jpg saved to cache
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7924489b-3116-5091-a4d1-da7cba232af0
2026-01-28 20:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7924489b-3116-5091-a4d1-da7cba232af0, skipping ID generation
2026-01-28 20:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7924489b-3116-5091-a4d1-da7cba232af0 with scrape type 1
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7924489b-3116-5091-a4d1-da7cba232af0 from tracking dictionaries
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7924489b-3116-5091-a4d1-da7cba232af0 sending to next pipeline
2026-01-28 20:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7924489b-3116-5091-a4d1-da7cba232af0, identifier: 1878356
2026-01-28 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/591/ed5f517b5cd641cdbf7316b16e96df9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:03 [ayvens.es] INFO: Found listing with ID: 1878367
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878367%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.es] INFO: Scrape type for 1878367: 1
2026-01-28 20:01:03 [ayvens.es] INFO: Extracting data for car ID: 1878367
2026-01-28 20:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5278a896-f4e3-58cc-90a7-1e1dc87124be with identifier: 1878367
2026-01-28 20:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5278a896-f4e3-58cc-90a7-1e1dc87124be with scrape type 1
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5278a896-f4e3-58cc-90a7-1e1dc87124be
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F094%252Fa0a783af0028406ca608d1f05d2e4d3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/094/a0a783af0028406ca608d1f05d2e4d3f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a1542ef6-906a-50f6-aa95-0ba5498e4d07 with identifier: 1878353
2026-01-28 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a1542ef6-906a-50f6-aa95-0ba5498e4d07 with identifier: 1878353
2026-01-28 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-28 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a1542ef6-906a-50f6-aa95-0ba5498e4d07 spider: ayvens.es
2026-01-28 20:01:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a1542ef6-906a-50f6-aa95-0ba5498e4d07 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a1542ef6-906a-50f6-aa95-0ba5498e4d07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 108988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1542ef6-906a-50f6-aa95-0ba5498e4d07/a1542ef6-906a-50f6-aa95-0ba5498e4d07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/955/094dc33bbf434cdebf51632cc59e6de6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 85KW (115CV) 6v Confort',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 85KW (115CV) 6v Confort',
 'vin': None,
 'year': 2018}
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878353%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.es] INFO: Saving data for 1878353: {'created_time': 1769630463.633188, 'last_price_update_time': 1769630463.633198, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878353') HTTP/1.1" 204 0
2026-01-28 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7924489b-3116-5091-a4d1-da7cba232af0 with identifier: 1878356
2026-01-28 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7924489b-3116-5091-a4d1-da7cba232af0 with identifier: 1878356
2026-01-28 20:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7924489b-3116-5091-a4d1-da7cba232af0 with identifier: 1878356 to the API
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/824/21f12709ab424977ae17b2506c34b8fb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7924489b-3116-5091-a4d1-da7cba232af0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 62206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7924489b-3116-5091-a4d1-da7cba232af0/7924489b-3116-5091-a4d1-da7cba232af0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/824/21f12709ab424977ae17b2506c34b8fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878356%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.es] INFO: Saving data for 1878356: {'created_time': 1769630464.578065, 'last_price_update_time': 1769630464.578073, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878356') HTTP/1.1" 204 0
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/271/c78f9d7d285f4cf2a9fd136eda9cfb96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [ayvens.es] INFO: Found listing with ID: 1878368
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878368%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.es] INFO: Scrape type for 1878368: 1
2026-01-28 20:01:04 [ayvens.es] INFO: Extracting data for car ID: 1878368
2026-01-28 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c4f307-efd4-5b86-9d66-8079e1f474c1 with identifier: 1878368
2026-01-28 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c4f307-efd4-5b86-9d66-8079e1f474c1 with scrape type 1
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13c4f307-efd4-5b86-9d66-8079e1f474c1
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F077%252Facabe9d304c34ee3b661c64f61db2fa3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/077/acabe9d304c34ee3b661c64f61db2fa3/images/large/1.jpg not downloaded yet
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81cdbae550>
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d677d61d-a331-5c20-8176-0e1336ba12ea/d677d61d-a331-5c20-8176-0e1336ba12ea_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252F7953a90116174ae983e48b6fc5d241fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/7953a90116174ae983e48b6fc5d241fd/images/large/1.jpg saved to cache
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d677d61d-a331-5c20-8176-0e1336ba12ea
2026-01-28 20:01:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d677d61d-a331-5c20-8176-0e1336ba12ea, skipping ID generation
2026-01-28 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d677d61d-a331-5c20-8176-0e1336ba12ea with scrape type 1
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d677d61d-a331-5c20-8176-0e1336ba12ea from tracking dictionaries
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d677d61d-a331-5c20-8176-0e1336ba12ea sending to next pipeline
2026-01-28 20:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d677d61d-a331-5c20-8176-0e1336ba12ea, identifier: 1878360
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca28ed10>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_745aeeeb-9d5d-5430-9244-a323b97822b8/745aeeeb-9d5d-5430-9244-a323b97822b8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252Fd65e654737ce4ae0b00e1e992ee9203d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/d65e654737ce4ae0b00e1e992ee9203d/images/large/1.jpg saved to cache
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 745aeeeb-9d5d-5430-9244-a323b97822b8
2026-01-28 20:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 745aeeeb-9d5d-5430-9244-a323b97822b8, skipping ID generation
2026-01-28 20:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 745aeeeb-9d5d-5430-9244-a323b97822b8 with scrape type 1
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 745aeeeb-9d5d-5430-9244-a323b97822b8 from tracking dictionaries
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 745aeeeb-9d5d-5430-9244-a323b97822b8 sending to next pipeline
2026-01-28 20:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 745aeeeb-9d5d-5430-9244-a323b97822b8, identifier: 1878359
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca2050d0>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_956df3fb-e1b8-5a52-983c-97d964e38259/956df3fb-e1b8-5a52-983c-97d964e38259_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252F2e3bf2c886744335a1c8b96dee4850cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/2e3bf2c886744335a1c8b96dee4850cd/images/large/1.jpg saved to cache
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 956df3fb-e1b8-5a52-983c-97d964e38259
2026-01-28 20:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 956df3fb-e1b8-5a52-983c-97d964e38259, skipping ID generation
2026-01-28 20:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956df3fb-e1b8-5a52-983c-97d964e38259 with scrape type 1
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 956df3fb-e1b8-5a52-983c-97d964e38259 from tracking dictionaries
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 956df3fb-e1b8-5a52-983c-97d964e38259 sending to next pipeline
2026-01-28 20:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 956df3fb-e1b8-5a52-983c-97d964e38259, identifier: 1878357
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca611a10>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_782c6c95-7bd0-50db-8403-754f48c69ae1/782c6c95-7bd0-50db-8403-754f48c69ae1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F591%252Fed5f517b5cd641cdbf7316b16e96df9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/591/ed5f517b5cd641cdbf7316b16e96df9d/images/large/1.jpg saved to cache
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 782c6c95-7bd0-50db-8403-754f48c69ae1
2026-01-28 20:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 782c6c95-7bd0-50db-8403-754f48c69ae1, skipping ID generation
2026-01-28 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 782c6c95-7bd0-50db-8403-754f48c69ae1 with scrape type 1
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 782c6c95-7bd0-50db-8403-754f48c69ae1 from tracking dictionaries
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 782c6c95-7bd0-50db-8403-754f48c69ae1 sending to next pipeline
2026-01-28 20:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 782c6c95-7bd0-50db-8403-754f48c69ae1, identifier: 1878358
2026-01-28 20:01:06 [ayvens.es] INFO: Found listing with ID: 1878369
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878369%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.es] INFO: Scrape type for 1878369: 1
2026-01-28 20:01:06 [ayvens.es] INFO: Extracting data for car ID: 1878369
2026-01-28 20:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76497289-e4a7-5822-a4cf-2733b3882a4b with identifier: 1878369
2026-01-28 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76497289-e4a7-5822-a4cf-2733b3882a4b with scrape type 1
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76497289-e4a7-5822-a4cf-2733b3882a4b
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F890%252F82692589e1044fefad27ff9b958fcf9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/890/82692589e1044fefad27ff9b958fcf9c/images/large/1.jpg not downloaded yet
2026-01-28 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d677d61d-a331-5c20-8176-0e1336ba12ea with identifier: 1878360
2026-01-28 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d677d61d-a331-5c20-8176-0e1336ba12ea with identifier: 1878360
2026-01-28 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d677d61d-a331-5c20-8176-0e1336ba12ea spider: ayvens.es
2026-01-28 20:01:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d677d61d-a331-5c20-8176-0e1336ba12ea due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Artico',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd677d61d-a331-5c20-8176-0e1336ba12ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CITAN',
 'odometer': 116528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d677d61d-a331-5c20-8176-0e1336ba12ea/d677d61d-a331-5c20-8176-0e1336ba12ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/359/7953a90116174ae983e48b6fc5d241fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CITAN 109 CDI Furgon Largo',
 'transmission': 'manual',
 'trim': '109 CDI Furgon Largo',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878360%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.es] INFO: Saving data for 1878360: {'created_time': 1769630466.653454, 'last_price_update_time': 1769630466.653466, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878360') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 745aeeeb-9d5d-5430-9244-a323b97822b8 with identifier: 1878359
2026-01-28 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 745aeeeb-9d5d-5430-9244-a323b97822b8 with identifier: 1878359
2026-01-28 20:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 745aeeeb-9d5d-5430-9244-a323b97822b8 with identifier: 1878359 to the API
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/495/d65e654737ce4ae0b00e1e992ee9203d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'White',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '745aeeeb-9d5d-5430-9244-a323b97822b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 45859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_745aeeeb-9d5d-5430-9244-a323b97822b8/745aeeeb-9d5d-5430-9244-a323b97822b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/495/d65e654737ce4ae0b00e1e992ee9203d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878359%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.es] INFO: Saving data for 1878359: {'created_time': 1769630467.549817, 'last_price_update_time': 1769630467.549826, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878359') HTTP/1.1" 204 0
2026-01-28 20:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 956df3fb-e1b8-5a52-983c-97d964e38259 with identifier: 1878357
2026-01-28 20:01:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 956df3fb-e1b8-5a52-983c-97d964e38259 with identifier: 1878357
2026-01-28 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-28 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 956df3fb-e1b8-5a52-983c-97d964e38259 spider: ayvens.es
2026-01-28 20:01:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 956df3fb-e1b8-5a52-983c-97d964e38259 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Race',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '956df3fb-e1b8-5a52-983c-97d964e38259',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 73974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_956df3fb-e1b8-5a52-983c-97d964e38259/956df3fb-e1b8-5a52-983c-97d964e38259_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/210/2e3bf2c886744335a1c8b96dee4850cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878357%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.es] INFO: Saving data for 1878357: {'created_time': 1769630467.811175, 'last_price_update_time': 1769630467.811186, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878357') HTTP/1.1" 204 0
2026-01-28 20:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 782c6c95-7bd0-50db-8403-754f48c69ae1 with identifier: 1878358
2026-01-28 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 782c6c95-7bd0-50db-8403-754f48c69ae1 with identifier: 1878358
2026-01-28 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161539 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161539
2026-01-28 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 782c6c95-7bd0-50db-8403-754f48c69ae1 spider: ayvens.es
2026-01-28 20:01:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 782c6c95-7bd0-50db-8403-754f48c69ae1 due to rule: high_mileage_for_country.json, error: 161539 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161539
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '782c6c95-7bd0-50db-8403-754f48c69ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 161539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_782c6c95-7bd0-50db-8403-754f48c69ae1/782c6c95-7bd0-50db-8403-754f48c69ae1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/591/ed5f517b5cd641cdbf7316b16e96df9d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878358%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.es] INFO: Saving data for 1878358: {'created_time': 1769630468.096285, 'last_price_update_time': 1769630468.096296, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878358') HTTP/1.1" 204 0
2026-01-28 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/741/ad307dc1d3584e1b98f4e1925223ad53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:08 [ayvens.es] INFO: Found listing with ID: 1878370
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878370%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.es] INFO: Scrape type for 1878370: 1
2026-01-28 20:01:08 [ayvens.es] INFO: Extracting data for car ID: 1878370
2026-01-28 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 with identifier: 1878370
2026-01-28 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 with scrape type 1
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 46e12f03-fb9f-5af2-9bbf-ce778b3d7822
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F265%252F4414594b75974d1b9faa9d005a66a122%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/265/4414594b75974d1b9faa9d005a66a122/images/large/1.jpg not downloaded yet
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca242cd0>
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fa93987-ff5e-530f-a4c0-8724c19efa41/3fa93987-ff5e-530f-a4c0-8724c19efa41_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F271%252Fc78f9d7d285f4cf2a9fd136eda9cfb96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/271/c78f9d7d285f4cf2a9fd136eda9cfb96/images/large/1.jpg saved to cache
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fa93987-ff5e-530f-a4c0-8724c19efa41
2026-01-28 20:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fa93987-ff5e-530f-a4c0-8724c19efa41, skipping ID generation
2026-01-28 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fa93987-ff5e-530f-a4c0-8724c19efa41 with scrape type 1
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3fa93987-ff5e-530f-a4c0-8724c19efa41 from tracking dictionaries
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fa93987-ff5e-530f-a4c0-8724c19efa41 sending to next pipeline
2026-01-28 20:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3fa93987-ff5e-530f-a4c0-8724c19efa41, identifier: 1878362
2026-01-28 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3fa93987-ff5e-530f-a4c0-8724c19efa41 with identifier: 1878362
2026-01-28 20:01:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3fa93987-ff5e-530f-a4c0-8724c19efa41 with identifier: 1878362
2026-01-28 20:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3fa93987-ff5e-530f-a4c0-8724c19efa41 with identifier: 1878362 to the API
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/271/c78f9d7d285f4cf2a9fd136eda9cfb96/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Cristal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3fa93987-ff5e-530f-a4c0-8724c19efa41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 86385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fa93987-ff5e-530f-a4c0-8724c19efa41/3fa93987-ff5e-530f-a4c0-8724c19efa41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/271/c78f9d7d285f4cf2a9fd136eda9cfb96/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT. PERF.LINE',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT. PERF.LINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878362%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [ayvens.es] INFO: Saving data for 1878362: {'created_time': 1769630469.040418, 'last_price_update_time': 1769630469.040433, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878362') HTTP/1.1" 204 0
2026-01-28 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/949/03d27e2d5f85463c9357e0e682e23991/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:09 [ayvens.es] INFO: Found listing with ID: 1878371
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878371%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [ayvens.es] INFO: Scrape type for 1878371: 1
2026-01-28 20:01:09 [ayvens.es] INFO: Extracting data for car ID: 1878371
2026-01-28 20:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67cfa60e-79bf-5db1-8da4-f3936850376c with identifier: 1878371
2026-01-28 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cfa60e-79bf-5db1-8da4-f3936850376c with scrape type 1
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 67cfa60e-79bf-5db1-8da4-f3936850376c
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252Ff81e2596f4a04d84875653e03a5c8026%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/f81e2596f4a04d84875653e03a5c8026/images/large/1.jpg not downloaded yet
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca266a50>
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfa0a8da-08e5-5e74-a864-15e3ad4133cc/cfa0a8da-08e5-5e74-a864-15e3ad4133cc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F741%252Fad307dc1d3584e1b98f4e1925223ad53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/741/ad307dc1d3584e1b98f4e1925223ad53/images/large/1.jpg saved to cache
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfa0a8da-08e5-5e74-a864-15e3ad4133cc
2026-01-28 20:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfa0a8da-08e5-5e74-a864-15e3ad4133cc, skipping ID generation
2026-01-28 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfa0a8da-08e5-5e74-a864-15e3ad4133cc with scrape type 1
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cfa0a8da-08e5-5e74-a864-15e3ad4133cc from tracking dictionaries
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfa0a8da-08e5-5e74-a864-15e3ad4133cc sending to next pipeline
2026-01-28 20:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cfa0a8da-08e5-5e74-a864-15e3ad4133cc, identifier: 1878363
2026-01-28 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/297/0a64f371f07b488db29cfdf0c5d80e6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:09 [ayvens.es] INFO: Found listing with ID: 1878372
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878372%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [ayvens.es] INFO: Scrape type for 1878372: 1
2026-01-28 20:01:09 [ayvens.es] INFO: Extracting data for car ID: 1878372
2026-01-28 20:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2d8105-ced2-5721-a5da-3f5e9bad9e95 with identifier: 1878372
2026-01-28 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2d8105-ced2-5721-a5da-3f5e9bad9e95 with scrape type 1
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da2d8105-ced2-5721-a5da-3f5e9bad9e95
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F062%252F6eed971dbd454572b675bdb1bb5f2707%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/062/6eed971dbd454572b675bdb1bb5f2707/images/large/1.jpg not downloaded yet
2026-01-28 20:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cfa0a8da-08e5-5e74-a864-15e3ad4133cc with identifier: 1878363
2026-01-28 20:01:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cfa0a8da-08e5-5e74-a864-15e3ad4133cc with identifier: 1878363
2026-01-28 20:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cfa0a8da-08e5-5e74-a864-15e3ad4133cc with identifier: 1878363 to the API
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/741/ad307dc1d3584e1b98f4e1925223ad53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Clear',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cfa0a8da-08e5-5e74-a864-15e3ad4133cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 50844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfa0a8da-08e5-5e74-a864-15e3ad4133cc/cfa0a8da-08e5-5e74-a864-15e3ad4133cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/741/ad307dc1d3584e1b98f4e1925223ad53/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878363%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [ayvens.es] INFO: Saving data for 1878363: {'created_time': 1769630470.040823, 'last_price_update_time': 1769630470.040836, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878363') HTTP/1.1" 204 0
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fccb10>
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d6e8af-8b0f-5e6b-b57e-a66367260b62/d6d6e8af-8b0f-5e6b-b57e-a66367260b62_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F393%252F1c886439098343b9b848c66a2fbb7e40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg saved to cache
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d6e8af-8b0f-5e6b-b57e-a66367260b62
2026-01-28 20:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d6e8af-8b0f-5e6b-b57e-a66367260b62, skipping ID generation
2026-01-28 20:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d6e8af-8b0f-5e6b-b57e-a66367260b62 with scrape type 1
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d6d6e8af-8b0f-5e6b-b57e-a66367260b62 from tracking dictionaries
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d6e8af-8b0f-5e6b-b57e-a66367260b62 sending to next pipeline
2026-01-28 20:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6d6e8af-8b0f-5e6b-b57e-a66367260b62, identifier: 1878361
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/094/a0a783af0028406ca608d1f05d2e4d3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [ayvens.es] INFO: Found listing with ID: 1878373
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878373%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [ayvens.es] INFO: Scrape type for 1878373: 1
2026-01-28 20:01:10 [ayvens.es] INFO: Extracting data for car ID: 1878373
2026-01-28 20:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace24ffd-c4cd-5637-ba8f-9fa454edc35a with identifier: 1878373
2026-01-28 20:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace24ffd-c4cd-5637-ba8f-9fa454edc35a with scrape type 1
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ace24ffd-c4cd-5637-ba8f-9fa454edc35a
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F237%252F4f8d1c2046814b66b879ac4ad260d0db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/237/4f8d1c2046814b66b879ac4ad260d0db/images/large/1.jpg not downloaded yet
2026-01-28 20:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6d6e8af-8b0f-5e6b-b57e-a66367260b62 with identifier: 1878361
2026-01-28 20:01:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6d6e8af-8b0f-5e6b-b57e-a66367260b62 with identifier: 1878361
2026-01-28 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'cooper', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'kuga', 'trim': '(o) 2.0 tdci 110kw 4x2 a-s-s titanium', 'title': 'ford kuga (o) 2.0 tdci 110kw 4x2 a-s-s titanium', 'price': 0, 'odometer': 216362, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-05', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 120, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'd6d6e8af-8b0f-5e6b-b57e-a66367260b62', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d6e8af-8b0f-5e6b-b57e-a66367260b62/d6d6e8af-8b0f-5e6b-b57e-a66367260b62_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 654270}], 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'ford kuga', 'sanitized_make': 'ford', 'odometer_in_km': 216362}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'cooper',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'd6d6e8af-8b0f-5e6b-b57e-a66367260b62',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford kuga',
     'model': 'kuga',
     'odometer': 216362,
     'odometer_in_km': 216362,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d6e8af-8b0f-5e6b-b57e-a66367260b62/d6d6e8af-8b0f-5e6b-b57e-a66367260b62_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 654270,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-12-05',
     'sanitized_make': 'ford',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ford kuga (o) 2.0 tdci 110kw 4x2 a-s-s titanium',
     'transmission': 'manual',
     'trim': '(o) 2.0 tdci 110kw 4x2 a-s-s titanium',
     'vin': None,
     'year': 2018}
2026-01-28 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: d6d6e8af-8b0f-5e6b-b57e-a66367260b62 spider: ayvens.es
2026-01-28 20:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d6d6e8af-8b0f-5e6b-b57e-a66367260b62 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'cooper', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'kuga', 'trim': '(o) 2.0 tdci 110kw 4x2 a-s-s titanium', 'title': 'ford kuga (o) 2.0 tdci 110kw 4x2 a-s-s titanium', 'price': 0, 'odometer': 216362, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-05', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 120, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'd6d6e8af-8b0f-5e6b-b57e-a66367260b62', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d6e8af-8b0f-5e6b-b57e-a66367260b62/d6d6e8af-8b0f-5e6b-b57e-a66367260b62_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 654270}], 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'ford kuga', 'sanitized_make': 'ford', 'odometer_in_km': 216362}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'cooper',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'd6d6e8af-8b0f-5e6b-b57e-a66367260b62',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford kuga',
     'model': 'kuga',
     'odometer': 216362,
     'odometer_in_km': 216362,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d6e8af-8b0f-5e6b-b57e-a66367260b62/d6d6e8af-8b0f-5e6b-b57e-a66367260b62_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 654270,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-12-05',
     'sanitized_make': 'ford',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ford kuga (o) 2.0 tdci 110kw 4x2 a-s-s titanium',
     'transmission': 'manual',
     'trim': '(o) 2.0 tdci 110kw 4x2 a-s-s titanium',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Cooper',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6d6e8af-8b0f-5e6b-b57e-a66367260b62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 216362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d6e8af-8b0f-5e6b-b57e-a66367260b62/d6d6e8af-8b0f-5e6b-b57e-a66367260b62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/393/1c886439098343b9b848c66a2fbb7e40/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA (O) 2.0 TDCi 110kW 4x2 A-S-S Titanium',
 'transmission': 'manual',
 'trim': '(O) 2.0 TDCi 110kW 4x2 A-S-S Titanium',
 'vin': None,
 'year': 2018}
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878361%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [ayvens.es] INFO: Saving data for 1878361: {'created_time': 1769630470.890498, 'last_price_update_time': 1769630470.89051, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878361') HTTP/1.1" 204 0
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/077/acabe9d304c34ee3b661c64f61db2fa3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca241610>
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_029275cb-1a4b-5f6a-af2e-ab1b82f8be98/029275cb-1a4b-5f6a-af2e-ab1b82f8be98_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F949%252F03d27e2d5f85463c9357e0e682e23991%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/949/03d27e2d5f85463c9357e0e682e23991/images/large/1.jpg saved to cache
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 029275cb-1a4b-5f6a-af2e-ab1b82f8be98
2026-01-28 20:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 029275cb-1a4b-5f6a-af2e-ab1b82f8be98, skipping ID generation
2026-01-28 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 with scrape type 1
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 from tracking dictionaries
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 sending to next pipeline
2026-01-28 20:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 029275cb-1a4b-5f6a-af2e-ab1b82f8be98, identifier: 1878364
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca64e3d0>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a3876a-e14c-5e36-a1c8-d869367da449/08a3876a-e14c-5e36-a1c8-d869367da449_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F297%252F0a64f371f07b488db29cfdf0c5d80e6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/297/0a64f371f07b488db29cfdf0c5d80e6d/images/large/1.jpg saved to cache
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08a3876a-e14c-5e36-a1c8-d869367da449
2026-01-28 20:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08a3876a-e14c-5e36-a1c8-d869367da449, skipping ID generation
2026-01-28 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a3876a-e14c-5e36-a1c8-d869367da449 with scrape type 1
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08a3876a-e14c-5e36-a1c8-d869367da449 from tracking dictionaries
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08a3876a-e14c-5e36-a1c8-d869367da449 sending to next pipeline
2026-01-28 20:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 08a3876a-e14c-5e36-a1c8-d869367da449, identifier: 1878366
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81cc82f350>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_604c0046-4036-5ce6-b192-b0957d3f2e07/604c0046-4036-5ce6-b192-b0957d3f2e07_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F346%252F099021c8202f47a584edfda2525ad2c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 604c0046-4036-5ce6-b192-b0957d3f2e07
2026-01-28 20:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 604c0046-4036-5ce6-b192-b0957d3f2e07, skipping ID generation
2026-01-28 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 604c0046-4036-5ce6-b192-b0957d3f2e07 with scrape type 1
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 604c0046-4036-5ce6-b192-b0957d3f2e07 from tracking dictionaries
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 604c0046-4036-5ce6-b192-b0957d3f2e07 sending to next pipeline
2026-01-28 20:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 604c0046-4036-5ce6-b192-b0957d3f2e07, identifier: 1878365
2026-01-28 20:01:12 [ayvens.es] INFO: Found listing with ID: 1878374
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878374%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [ayvens.es] INFO: Scrape type for 1878374: 1
2026-01-28 20:01:12 [ayvens.es] INFO: Extracting data for car ID: 1878374
2026-01-28 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ad218cd-8ba6-534e-9520-46abb2b30b89 with identifier: 1878374
2026-01-28 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ad218cd-8ba6-534e-9520-46abb2b30b89 with scrape type 1
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ad218cd-8ba6-534e-9520-46abb2b30b89
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F908%252F3c4ecd6b6d65461dbfa287f2e837f317%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/908/3c4ecd6b6d65461dbfa287f2e837f317/images/large/1.jpg not downloaded yet
2026-01-28 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 with identifier: 1878364
2026-01-28 20:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 with identifier: 1878364
2026-01-28 20:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 029275cb-1a4b-5f6a-af2e-ab1b82f8be98 with identifier: 1878364 to the API
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/949/03d27e2d5f85463c9357e0e682e23991/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '029275cb-1a4b-5f6a-af2e-ab1b82f8be98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 32253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_029275cb-1a4b-5f6a-af2e-ab1b82f8be98/029275cb-1a4b-5f6a-af2e-ab1b82f8be98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/949/03d27e2d5f85463c9357e0e682e23991/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878364%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [ayvens.es] INFO: Saving data for 1878364: {'created_time': 1769630472.640032, 'last_price_update_time': 1769630472.640044, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878364') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 08a3876a-e14c-5e36-a1c8-d869367da449 with identifier: 1878366
2026-01-28 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 08a3876a-e14c-5e36-a1c8-d869367da449 with identifier: 1878366
2026-01-28 20:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 08a3876a-e14c-5e36-a1c8-d869367da449 with identifier: 1878366 to the API
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/297/0a64f371f07b488db29cfdf0c5d80e6d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '08a3876a-e14c-5e36-a1c8-d869367da449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 94170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a3876a-e14c-5e36-a1c8-d869367da449/08a3876a-e14c-5e36-a1c8-d869367da449_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/297/0a64f371f07b488db29cfdf0c5d80e6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878366%27 HTTP/1.1" 200 None
2026-01-28 20:01:13 [ayvens.es] INFO: Saving data for 1878366: {'created_time': 1769630473.249171, 'last_price_update_time': 1769630473.249184, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878366') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 604c0046-4036-5ce6-b192-b0957d3f2e07 with identifier: 1878365
2026-01-28 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 604c0046-4036-5ce6-b192-b0957d3f2e07 with identifier: 1878365
2026-01-28 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': '5p business line bluehdi 100 s&s 6v man', 'title': 'peugeot 308 5p business line bluehdi 100 s&s 6v man', 'price': 0, 'odometer': 243501, 'odometer_reading_unit': 'km', 'registration_date': '2020-03-05', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 91, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '604c0046-4036-5ce6-b192-b0957d3f2e07', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_604c0046-4036-5ce6-b192-b0957d3f2e07/604c0046-4036-5ce6-b192-b0957d3f2e07_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 343085}], 'current_year_diff': 6, 'age_in_months': 70, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 243501}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 91,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '604c0046-4036-5ce6-b192-b0957d3f2e07',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 243501,
     'odometer_in_km': 243501,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_604c0046-4036-5ce6-b192-b0957d3f2e07/604c0046-4036-5ce6-b192-b0957d3f2e07_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 343085,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 5p business line bluehdi 100 s&s 6v man',
     'transmission': 'manual',
     'trim': '5p business line bluehdi 100 s&s 6v man',
     'vin': None,
     'year': 2020}
2026-01-28 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 604c0046-4036-5ce6-b192-b0957d3f2e07 spider: ayvens.es
2026-01-28 20:01:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 604c0046-4036-5ce6-b192-b0957d3f2e07 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': '5p business line bluehdi 100 s&s 6v man', 'title': 'peugeot 308 5p business line bluehdi 100 s&s 6v man', 'price': 0, 'odometer': 243501, 'odometer_reading_unit': 'km', 'registration_date': '2020-03-05', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 91, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '604c0046-4036-5ce6-b192-b0957d3f2e07', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_604c0046-4036-5ce6-b192-b0957d3f2e07/604c0046-4036-5ce6-b192-b0957d3f2e07_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 343085}], 'current_year_diff': 6, 'age_in_months': 70, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 243501}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 91,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '604c0046-4036-5ce6-b192-b0957d3f2e07',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 243501,
     'odometer_in_km': 243501,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_604c0046-4036-5ce6-b192-b0957d3f2e07/604c0046-4036-5ce6-b192-b0957d3f2e07_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 343085,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 5p business line bluehdi 100 s&s 6v man',
     'transmission': 'manual',
     'trim': '5p business line bluehdi 100 s&s 6v man',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '604c0046-4036-5ce6-b192-b0957d3f2e07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 243501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_604c0046-4036-5ce6-b192-b0957d3f2e07/604c0046-4036-5ce6-b192-b0957d3f2e07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/346/099021c8202f47a584edfda2525ad2c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Business Line BlueHDi 100 S&S 6V MAN',
 'transmission': 'manual',
 'trim': '5P Business Line BlueHDi 100 S&S 6V MAN',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878365%27 HTTP/1.1" 200 None
2026-01-28 20:01:13 [ayvens.es] INFO: Saving data for 1878365: {'created_time': 1769630473.519564, 'last_price_update_time': 1769630473.519576, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878365') HTTP/1.1" 204 0
2026-01-28 20:01:13 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 4 pages/min), scraped 18 items (at 18 items/min)
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fd3810>
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5278a896-f4e3-58cc-90a7-1e1dc87124be/5278a896-f4e3-58cc-90a7-1e1dc87124be_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F094%252Fa0a783af0028406ca608d1f05d2e4d3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/094/a0a783af0028406ca608d1f05d2e4d3f/images/large/1.jpg saved to cache
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5278a896-f4e3-58cc-90a7-1e1dc87124be
2026-01-28 20:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5278a896-f4e3-58cc-90a7-1e1dc87124be, skipping ID generation
2026-01-28 20:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5278a896-f4e3-58cc-90a7-1e1dc87124be with scrape type 1
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5278a896-f4e3-58cc-90a7-1e1dc87124be from tracking dictionaries
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5278a896-f4e3-58cc-90a7-1e1dc87124be sending to next pipeline
2026-01-28 20:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5278a896-f4e3-58cc-90a7-1e1dc87124be, identifier: 1878367
2026-01-28 20:01:14 [ayvens.es] INFO: Found listing with ID: 1878375
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878375%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [ayvens.es] INFO: Scrape type for 1878375: 1
2026-01-28 20:01:14 [ayvens.es] INFO: Extracting data for car ID: 1878375
2026-01-28 20:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661d7d7d-2a74-532e-952d-e0ff925f460c with identifier: 1878375
2026-01-28 20:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661d7d7d-2a74-532e-952d-e0ff925f460c with scrape type 1
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 661d7d7d-2a74-532e-952d-e0ff925f460c
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F118%252F2efdf39654994a7080aa55b0776ecae7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/118/2efdf39654994a7080aa55b0776ecae7/images/large/1.jpg not downloaded yet
2026-01-28 20:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5278a896-f4e3-58cc-90a7-1e1dc87124be with identifier: 1878367
2026-01-28 20:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5278a896-f4e3-58cc-90a7-1e1dc87124be with identifier: 1878367
2026-01-28 20:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5278a896-f4e3-58cc-90a7-1e1dc87124be with identifier: 1878367 to the API
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/094/a0a783af0028406ca608d1f05d2e4d3f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5278a896-f4e3-58cc-90a7-1e1dc87124be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 66565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5278a896-f4e3-58cc-90a7-1e1dc87124be/5278a896-f4e3-58cc-90a7-1e1dc87124be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/094/a0a783af0028406ca608d1f05d2e4d3f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'transmission': 'manual',
 'trim': 'IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878367%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [ayvens.es] INFO: Saving data for 1878367: {'created_time': 1769630474.548627, 'last_price_update_time': 1769630474.548639, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878367') HTTP/1.1" 204 0
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c915aa50>
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c4f307-efd4-5b86-9d66-8079e1f474c1/13c4f307-efd4-5b86-9d66-8079e1f474c1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F077%252Facabe9d304c34ee3b661c64f61db2fa3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/077/acabe9d304c34ee3b661c64f61db2fa3/images/large/1.jpg saved to cache
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13c4f307-efd4-5b86-9d66-8079e1f474c1
2026-01-28 20:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13c4f307-efd4-5b86-9d66-8079e1f474c1, skipping ID generation
2026-01-28 20:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c4f307-efd4-5b86-9d66-8079e1f474c1 with scrape type 1
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 13c4f307-efd4-5b86-9d66-8079e1f474c1 from tracking dictionaries
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13c4f307-efd4-5b86-9d66-8079e1f474c1 sending to next pipeline
2026-01-28 20:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13c4f307-efd4-5b86-9d66-8079e1f474c1, identifier: 1878368
2026-01-28 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/890/82692589e1044fefad27ff9b958fcf9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13c4f307-efd4-5b86-9d66-8079e1f474c1 with identifier: 1878368
2026-01-28 20:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13c4f307-efd4-5b86-9d66-8079e1f474c1 with identifier: 1878368
2026-01-28 20:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13c4f307-efd4-5b86-9d66-8079e1f474c1 with identifier: 1878368 to the API
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/077/acabe9d304c34ee3b661c64f61db2fa3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '13c4f307-efd4-5b86-9d66-8079e1f474c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 36970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c4f307-efd4-5b86-9d66-8079e1f474c1/13c4f307-efd4-5b86-9d66-8079e1f474c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/077/acabe9d304c34ee3b661c64f61db2fa3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) Plus',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) Plus',
 'vin': None,
 'year': 2024}
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878368%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [ayvens.es] INFO: Saving data for 1878368: {'created_time': 1769630475.481559, 'last_price_update_time': 1769630475.481568, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878368') HTTP/1.1" 204 0
2026-01-28 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/265/4414594b75974d1b9faa9d005a66a122/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:15 [ayvens.es] INFO: Found listing with ID: 1878376
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878376%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [ayvens.es] INFO: Scrape type for 1878376: 1
2026-01-28 20:01:15 [ayvens.es] INFO: Extracting data for car ID: 1878376
2026-01-28 20:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1410a57d-9815-5c58-a9e2-a3a95a7627eb with identifier: 1878376
2026-01-28 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1410a57d-9815-5c58-a9e2-a3a95a7627eb with scrape type 1
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1410a57d-9815-5c58-a9e2-a3a95a7627eb
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F9b600b7b3c084778bbd56dd073a012a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/9b600b7b3c084778bbd56dd073a012a1/images/large/1.jpg not downloaded yet
2026-01-28 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/690/f81e2596f4a04d84875653e03a5c8026/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:15 [ayvens.es] INFO: Found listing with ID: 1878377
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878377%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [ayvens.es] INFO: Scrape type for 1878377: 1
2026-01-28 20:01:15 [ayvens.es] INFO: Extracting data for car ID: 1878377
2026-01-28 20:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 with identifier: 1878377
2026-01-28 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 with scrape type 1
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F094%252Fa933fd2be16944c2a6637988afc68f3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/094/a933fd2be16944c2a6637988afc68f3f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/237/4f8d1c2046814b66b879ac4ad260d0db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/062/6eed971dbd454572b675bdb1bb5f2707/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca897550>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76497289-e4a7-5822-a4cf-2733b3882a4b/76497289-e4a7-5822-a4cf-2733b3882a4b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F890%252F82692589e1044fefad27ff9b958fcf9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/890/82692589e1044fefad27ff9b958fcf9c/images/large/1.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76497289-e4a7-5822-a4cf-2733b3882a4b
2026-01-28 20:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76497289-e4a7-5822-a4cf-2733b3882a4b, skipping ID generation
2026-01-28 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76497289-e4a7-5822-a4cf-2733b3882a4b with scrape type 1
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 76497289-e4a7-5822-a4cf-2733b3882a4b from tracking dictionaries
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76497289-e4a7-5822-a4cf-2733b3882a4b sending to next pipeline
2026-01-28 20:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 76497289-e4a7-5822-a4cf-2733b3882a4b, identifier: 1878369
2026-01-28 20:01:16 [ayvens.es] INFO: Found listing with ID: 1878378
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878378%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [ayvens.es] INFO: Scrape type for 1878378: 1
2026-01-28 20:01:16 [ayvens.es] INFO: Extracting data for car ID: 1878378
2026-01-28 20:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67b942cb-c9e7-5b66-ac6c-6389263fe639 with identifier: 1878378
2026-01-28 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b942cb-c9e7-5b66-ac6c-6389263fe639 with scrape type 1
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 67b942cb-c9e7-5b66-ac6c-6389263fe639
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F534%252F2b0458043ba54ae3817619a5299b8987%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/534/2b0458043ba54ae3817619a5299b8987/images/large/1.jpg not downloaded yet
2026-01-28 20:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 76497289-e4a7-5822-a4cf-2733b3882a4b with identifier: 1878369
2026-01-28 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 76497289-e4a7-5822-a4cf-2733b3882a4b with identifier: 1878369
2026-01-28 20:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 76497289-e4a7-5822-a4cf-2733b3882a4b with identifier: 1878369 to the API
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/890/82692589e1044fefad27ff9b958fcf9c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '76497289-e4a7-5822-a4cf-2733b3882a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 65177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76497289-e4a7-5822-a4cf-2733b3882a4b/76497289-e4a7-5822-a4cf-2733b3882a4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/890/82692589e1044fefad27ff9b958fcf9c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 1.5 TSI 110kW (150 CV) Tech Edition DSG',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW (150 CV) Tech Edition DSG',
 'vin': None,
 'year': 2024}
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878369%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [ayvens.es] INFO: Saving data for 1878369: {'created_time': 1769630476.973209, 'last_price_update_time': 1769630476.973223, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878369') HTTP/1.1" 204 0
2026-01-28 20:01:16 [ayvens.es] INFO: Found listing with ID: 1878379
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878379%27 HTTP/1.1" 200 None
2026-01-28 20:01:17 [ayvens.es] INFO: Scrape type for 1878379: 1
2026-01-28 20:01:17 [ayvens.es] INFO: Extracting data for car ID: 1878379
2026-01-28 20:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28dc35b2-292d-58d4-a3d6-7d6e7193e548 with identifier: 1878379
2026-01-28 20:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28dc35b2-292d-58d4-a3d6-7d6e7193e548 with scrape type 1
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 28dc35b2-292d-58d4-a3d6-7d6e7193e548
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252F2192310f70c6481dbc02d27f70d737fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/2192310f70c6481dbc02d27f70d737fc/images/large/1.jpg not downloaded yet
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca665b90>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46e12f03-fb9f-5af2-9bbf-ce778b3d7822/46e12f03-fb9f-5af2-9bbf-ce778b3d7822_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F265%252F4414594b75974d1b9faa9d005a66a122%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/265/4414594b75974d1b9faa9d005a66a122/images/large/1.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46e12f03-fb9f-5af2-9bbf-ce778b3d7822
2026-01-28 20:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46e12f03-fb9f-5af2-9bbf-ce778b3d7822, skipping ID generation
2026-01-28 20:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 with scrape type 1
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 from tracking dictionaries
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 sending to next pipeline
2026-01-28 20:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 46e12f03-fb9f-5af2-9bbf-ce778b3d7822, identifier: 1878370
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c917b250>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cfa60e-79bf-5db1-8da4-f3936850376c/67cfa60e-79bf-5db1-8da4-f3936850376c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252Ff81e2596f4a04d84875653e03a5c8026%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/f81e2596f4a04d84875653e03a5c8026/images/large/1.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67cfa60e-79bf-5db1-8da4-f3936850376c
2026-01-28 20:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67cfa60e-79bf-5db1-8da4-f3936850376c, skipping ID generation
2026-01-28 20:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cfa60e-79bf-5db1-8da4-f3936850376c with scrape type 1
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67cfa60e-79bf-5db1-8da4-f3936850376c from tracking dictionaries
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67cfa60e-79bf-5db1-8da4-f3936850376c sending to next pipeline
2026-01-28 20:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 67cfa60e-79bf-5db1-8da4-f3936850376c, identifier: 1878371
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca207e50>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ace24ffd-c4cd-5637-ba8f-9fa454edc35a/ace24ffd-c4cd-5637-ba8f-9fa454edc35a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F237%252F4f8d1c2046814b66b879ac4ad260d0db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/237/4f8d1c2046814b66b879ac4ad260d0db/images/large/1.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ace24ffd-c4cd-5637-ba8f-9fa454edc35a
2026-01-28 20:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ace24ffd-c4cd-5637-ba8f-9fa454edc35a, skipping ID generation
2026-01-28 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace24ffd-c4cd-5637-ba8f-9fa454edc35a with scrape type 1
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ace24ffd-c4cd-5637-ba8f-9fa454edc35a from tracking dictionaries
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ace24ffd-c4cd-5637-ba8f-9fa454edc35a sending to next pipeline
2026-01-28 20:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ace24ffd-c4cd-5637-ba8f-9fa454edc35a, identifier: 1878373
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9146110>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2d8105-ced2-5721-a5da-3f5e9bad9e95/da2d8105-ced2-5721-a5da-3f5e9bad9e95_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F062%252F6eed971dbd454572b675bdb1bb5f2707%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/062/6eed971dbd454572b675bdb1bb5f2707/images/large/1.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da2d8105-ced2-5721-a5da-3f5e9bad9e95
2026-01-28 20:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da2d8105-ced2-5721-a5da-3f5e9bad9e95, skipping ID generation
2026-01-28 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2d8105-ced2-5721-a5da-3f5e9bad9e95 with scrape type 1
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item da2d8105-ced2-5721-a5da-3f5e9bad9e95 from tracking dictionaries
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da2d8105-ced2-5721-a5da-3f5e9bad9e95 sending to next pipeline
2026-01-28 20:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da2d8105-ced2-5721-a5da-3f5e9bad9e95, identifier: 1878372
2026-01-28 20:01:18 [ayvens.es] INFO: Found listing with ID: 1878380
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878380%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [ayvens.es] INFO: Scrape type for 1878380: 1
2026-01-28 20:01:18 [ayvens.es] INFO: Extracting data for car ID: 1878380
2026-01-28 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dac4fa9-387e-5b04-855d-07f5f015ccac with identifier: 1878380
2026-01-28 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dac4fa9-387e-5b04-855d-07f5f015ccac with scrape type 1
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9dac4fa9-387e-5b04-855d-07f5f015ccac
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F427%252Fe400c3160ba8477a8e81dd5f5b74cd5e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/427/e400c3160ba8477a8e81dd5f5b74cd5e/images/large/1.jpg not downloaded yet
2026-01-28 20:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 with identifier: 1878370
2026-01-28 20:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 with identifier: 1878370
2026-01-28 20:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 46e12f03-fb9f-5af2-9bbf-ce778b3d7822 with identifier: 1878370 to the API
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/265/4414594b75974d1b9faa9d005a66a122/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '46e12f03-fb9f-5af2-9bbf-ce778b3d7822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 61293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e12f03-fb9f-5af2-9bbf-ce778b3d7822/46e12f03-fb9f-5af2-9bbf-ce778b3d7822_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/265/4414594b75974d1b9faa9d005a66a122/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 125cv ST-Line X MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125cv ST-Line X MHEV',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878370%27 HTTP/1.1" 200 None
2026-01-28 20:01:19 [ayvens.es] INFO: Saving data for 1878370: {'created_time': 1769630479.281227, 'last_price_update_time': 1769630479.28124, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878370') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 67cfa60e-79bf-5db1-8da4-f3936850376c with identifier: 1878371
2026-01-28 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 67cfa60e-79bf-5db1-8da4-f3936850376c with identifier: 1878371
2026-01-28 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 67cfa60e-79bf-5db1-8da4-f3936850376c with identifier: 1878371 to the API
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/690/f81e2596f4a04d84875653e03a5c8026/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '67cfa60e-79bf-5db1-8da4-f3936850376c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 127715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cfa60e-79bf-5db1-8da4-f3936850376c/67cfa60e-79bf-5db1-8da4-f3936850376c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/f81e2596f4a04d84875653e03a5c8026/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 200 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 200 D DCT',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878371%27 HTTP/1.1" 200 None
2026-01-28 20:01:19 [ayvens.es] INFO: Saving data for 1878371: {'created_time': 1769630479.757351, 'last_price_update_time': 1769630479.757362, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878371') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ace24ffd-c4cd-5637-ba8f-9fa454edc35a with identifier: 1878373
2026-01-28 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ace24ffd-c4cd-5637-ba8f-9fa454edc35a with identifier: 1878373
2026-01-28 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-28 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ace24ffd-c4cd-5637-ba8f-9fa454edc35a spider: ayvens.es
2026-01-28 20:01:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ace24ffd-c4cd-5637-ba8f-9fa454edc35a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ace24ffd-c4cd-5637-ba8f-9fa454edc35a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 114881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ace24ffd-c4cd-5637-ba8f-9fa454edc35a/ace24ffd-c4cd-5637-ba8f-9fa454edc35a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/237/4f8d1c2046814b66b879ac4ad260d0db/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878373%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [ayvens.es] INFO: Saving data for 1878373: {'created_time': 1769630480.011665, 'last_price_update_time': 1769630480.011677, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878373') HTTP/1.1" 204 0
2026-01-28 20:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da2d8105-ced2-5721-a5da-3f5e9bad9e95 with identifier: 1878372
2026-01-28 20:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da2d8105-ced2-5721-a5da-3f5e9bad9e95 with identifier: 1878372
2026-01-28 20:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-28 20:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: da2d8105-ced2-5721-a5da-3f5e9bad9e95 spider: ayvens.es
2026-01-28 20:01:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: da2d8105-ced2-5721-a5da-3f5e9bad9e95 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da2d8105-ced2-5721-a5da-3f5e9bad9e95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 42057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2d8105-ced2-5721-a5da-3f5e9bad9e95/da2d8105-ced2-5721-a5da-3f5e9bad9e95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/062/6eed971dbd454572b675bdb1bb5f2707/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878372%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [ayvens.es] INFO: Saving data for 1878372: {'created_time': 1769630480.275771, 'last_price_update_time': 1769630480.275783, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878372') HTTP/1.1" 204 0
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/908/3c4ecd6b6d65461dbfa287f2e837f317/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:20 [ayvens.es] INFO: Found listing with ID: 1878381
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878381%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [ayvens.es] INFO: Scrape type for 1878381: 1
2026-01-28 20:01:20 [ayvens.es] INFO: Extracting data for car ID: 1878381
2026-01-28 20:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 739d25f1-1a59-5449-a12f-4b8de918ec6e with identifier: 1878381
2026-01-28 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 739d25f1-1a59-5449-a12f-4b8de918ec6e with scrape type 1
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 739d25f1-1a59-5449-a12f-4b8de918ec6e
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F49630b701a254a7d8eab8d9eb66fde4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/49630b701a254a7d8eab8d9eb66fde4c/images/large/1.jpg not downloaded yet
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/118/2efdf39654994a7080aa55b0776ecae7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/897/9b600b7b3c084778bbd56dd073a012a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:20 [ayvens.es] INFO: Found listing with ID: 1878382
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878382%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [ayvens.es] INFO: Scrape type for 1878382: 1
2026-01-28 20:01:20 [ayvens.es] INFO: Extracting data for car ID: 1878382
2026-01-28 20:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22bb86e1-7533-52bb-9a6c-bb80759e6f26 with identifier: 1878382
2026-01-28 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22bb86e1-7533-52bb-9a6c-bb80759e6f26 with scrape type 1
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 22bb86e1-7533-52bb-9a6c-bb80759e6f26
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252F454e5a5effb8497da96e0ca9f3c04432%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/454e5a5effb8497da96e0ca9f3c04432/images/large/1.jpg not downloaded yet
2026-01-28 20:01:20 [ayvens.es] INFO: Found listing with ID: 1878383
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878383%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [ayvens.es] INFO: Scrape type for 1878383: 1
2026-01-28 20:01:20 [ayvens.es] INFO: Extracting data for car ID: 1878383
2026-01-28 20:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 with identifier: 1878383
2026-01-28 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 with scrape type 1
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0792b02a-c407-5da2-b3c2-e71d0ddc0a68
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F976%252F00b8719333524dbead3a892428e6d9a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/976/00b8719333524dbead3a892428e6d9a2/images/large/1.jpg not downloaded yet
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/094/a933fd2be16944c2a6637988afc68f3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/534/2b0458043ba54ae3817619a5299b8987/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:20 [ayvens.es] INFO: Found listing with ID: 1878384
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878384%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [ayvens.es] INFO: Scrape type for 1878384: 1
2026-01-28 20:01:20 [ayvens.es] INFO: Extracting data for car ID: 1878384
2026-01-28 20:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 with identifier: 1878384
2026-01-28 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 with scrape type 1
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cc014a2-c74d-5bd2-93d4-2a5f0153b246
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252F94551d477e0a406ba7f09b51080f17aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/94551d477e0a406ba7f09b51080f17aa/images/large/1.jpg not downloaded yet
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c915c050>
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ad218cd-8ba6-534e-9520-46abb2b30b89/9ad218cd-8ba6-534e-9520-46abb2b30b89_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F908%252F3c4ecd6b6d65461dbfa287f2e837f317%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/908/3c4ecd6b6d65461dbfa287f2e837f317/images/large/1.jpg saved to cache
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ad218cd-8ba6-534e-9520-46abb2b30b89
2026-01-28 20:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ad218cd-8ba6-534e-9520-46abb2b30b89, skipping ID generation
2026-01-28 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ad218cd-8ba6-534e-9520-46abb2b30b89 with scrape type 1
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9ad218cd-8ba6-534e-9520-46abb2b30b89 from tracking dictionaries
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ad218cd-8ba6-534e-9520-46abb2b30b89 sending to next pipeline
2026-01-28 20:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ad218cd-8ba6-534e-9520-46abb2b30b89, identifier: 1878374
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91429d0>
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661d7d7d-2a74-532e-952d-e0ff925f460c/661d7d7d-2a74-532e-952d-e0ff925f460c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F118%252F2efdf39654994a7080aa55b0776ecae7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/118/2efdf39654994a7080aa55b0776ecae7/images/large/1.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 661d7d7d-2a74-532e-952d-e0ff925f460c
2026-01-28 20:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 661d7d7d-2a74-532e-952d-e0ff925f460c, skipping ID generation
2026-01-28 20:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661d7d7d-2a74-532e-952d-e0ff925f460c with scrape type 1
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 661d7d7d-2a74-532e-952d-e0ff925f460c from tracking dictionaries
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 661d7d7d-2a74-532e-952d-e0ff925f460c sending to next pipeline
2026-01-28 20:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 661d7d7d-2a74-532e-952d-e0ff925f460c, identifier: 1878375
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912fc90>
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1410a57d-9815-5c58-a9e2-a3a95a7627eb/1410a57d-9815-5c58-a9e2-a3a95a7627eb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F9b600b7b3c084778bbd56dd073a012a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/9b600b7b3c084778bbd56dd073a012a1/images/large/1.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1410a57d-9815-5c58-a9e2-a3a95a7627eb
2026-01-28 20:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1410a57d-9815-5c58-a9e2-a3a95a7627eb, skipping ID generation
2026-01-28 20:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1410a57d-9815-5c58-a9e2-a3a95a7627eb with scrape type 1
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1410a57d-9815-5c58-a9e2-a3a95a7627eb from tracking dictionaries
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1410a57d-9815-5c58-a9e2-a3a95a7627eb sending to next pipeline
2026-01-28 20:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1410a57d-9815-5c58-a9e2-a3a95a7627eb, identifier: 1878376
2026-01-28 20:01:22 [ayvens.es] INFO: Found listing with ID: 1878385
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878385%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [ayvens.es] INFO: Scrape type for 1878385: 1
2026-01-28 20:01:22 [ayvens.es] INFO: Extracting data for car ID: 1878385
2026-01-28 20:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea8cb940-3e1b-5908-aa23-08328534cb2e with identifier: 1878385
2026-01-28 20:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8cb940-3e1b-5908-aa23-08328534cb2e with scrape type 1
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ea8cb940-3e1b-5908-aa23-08328534cb2e
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F577%252F764111f4089444dfa1ac433b17f7f9ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/577/764111f4089444dfa1ac433b17f7f9ad/images/large/1.jpg not downloaded yet
2026-01-28 20:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ad218cd-8ba6-534e-9520-46abb2b30b89 with identifier: 1878374
2026-01-28 20:01:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ad218cd-8ba6-534e-9520-46abb2b30b89 with identifier: 1878374
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9ad218cd-8ba6-534e-9520-46abb2b30b89 spider: ayvens.es
2026-01-28 20:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 9ad218cd-8ba6-534e-9520-46abb2b30b89 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9ad218cd-8ba6-534e-9520-46abb2b30b89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 51047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ad218cd-8ba6-534e-9520-46abb2b30b89/9ad218cd-8ba6-534e-9520-46abb2b30b89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/908/3c4ecd6b6d65461dbfa287f2e837f317/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 59 kW (80CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 59 kW (80CV)',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878374%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [ayvens.es] INFO: Saving data for 1878374: {'created_time': 1769630482.283405, 'last_price_update_time': 1769630482.283415, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878374') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 661d7d7d-2a74-532e-952d-e0ff925f460c with identifier: 1878375
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 661d7d7d-2a74-532e-952d-e0ff925f460c with identifier: 1878375
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144927 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144927
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 661d7d7d-2a74-532e-952d-e0ff925f460c spider: ayvens.es
2026-01-28 20:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 661d7d7d-2a74-532e-952d-e0ff925f460c due to rule: high_mileage_for_make.json, error: 144927 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144927
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '661d7d7d-2a74-532e-952d-e0ff925f460c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 144927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661d7d7d-2a74-532e-952d-e0ff925f460c/661d7d7d-2a74-532e-952d-e0ff925f460c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/118/2efdf39654994a7080aa55b0776ecae7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878375%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [ayvens.es] INFO: Saving data for 1878375: {'created_time': 1769630482.643304, 'last_price_update_time': 1769630482.643318, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878375') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1410a57d-9815-5c58-a9e2-a3a95a7627eb with identifier: 1878376
2026-01-28 20:01:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1410a57d-9815-5c58-a9e2-a3a95a7627eb with identifier: 1878376
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157474 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157474
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1410a57d-9815-5c58-a9e2-a3a95a7627eb spider: ayvens.es
2026-01-28 20:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1410a57d-9815-5c58-a9e2-a3a95a7627eb due to rule: high_mileage_for_country.json, error: 157474 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157474
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Nightshade',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1410a57d-9815-5c58-a9e2-a3a95a7627eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 157474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1410a57d-9815-5c58-a9e2-a3a95a7627eb/1410a57d-9815-5c58-a9e2-a3a95a7627eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/897/9b600b7b3c084778bbd56dd073a012a1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878376%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [ayvens.es] INFO: Saving data for 1878376: {'created_time': 1769630482.945311, 'last_price_update_time': 1769630482.945322, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878376') HTTP/1.1" 204 0
2026-01-28 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/257/2192310f70c6481dbc02d27f70d737fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:22 [ayvens.es] INFO: Found listing with ID: 1878386
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878386%27 HTTP/1.1" 200 None
2026-01-28 20:01:23 [ayvens.es] INFO: Scrape type for 1878386: 1
2026-01-28 20:01:23 [ayvens.es] INFO: Extracting data for car ID: 1878386
2026-01-28 20:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e834ba3-fa32-52ae-9a83-6883889b2a9a with identifier: 1878386
2026-01-28 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e834ba3-fa32-52ae-9a83-6883889b2a9a with scrape type 1
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e834ba3-fa32-52ae-9a83-6883889b2a9a
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F9e9c7b2875f14ef89aa46a434c4f6372%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/9e9c7b2875f14ef89aa46a434c4f6372/images/large/1.jpg not downloaded yet
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9107450>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2/ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F094%252Fa933fd2be16944c2a6637988afc68f3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/094/a933fd2be16944c2a6637988afc68f3f/images/large/1.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2
2026-01-28 20:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2, skipping ID generation
2026-01-28 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 with scrape type 1
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 from tracking dictionaries
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 sending to next pipeline
2026-01-28 20:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2, identifier: 1878377
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81cf381810>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b942cb-c9e7-5b66-ac6c-6389263fe639/67b942cb-c9e7-5b66-ac6c-6389263fe639_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F534%252F2b0458043ba54ae3817619a5299b8987%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/534/2b0458043ba54ae3817619a5299b8987/images/large/1.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67b942cb-c9e7-5b66-ac6c-6389263fe639
2026-01-28 20:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67b942cb-c9e7-5b66-ac6c-6389263fe639, skipping ID generation
2026-01-28 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b942cb-c9e7-5b66-ac6c-6389263fe639 with scrape type 1
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67b942cb-c9e7-5b66-ac6c-6389263fe639 from tracking dictionaries
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67b942cb-c9e7-5b66-ac6c-6389263fe639 sending to next pipeline
2026-01-28 20:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 67b942cb-c9e7-5b66-ac6c-6389263fe639, identifier: 1878378
2026-01-28 20:01:24 [ayvens.es] INFO: Found listing with ID: 1878387
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878387%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [ayvens.es] INFO: Scrape type for 1878387: 1
2026-01-28 20:01:24 [ayvens.es] INFO: Extracting data for car ID: 1878387
2026-01-28 20:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d985c33d-9829-530a-9c8b-8959e53de1a2 with identifier: 1878387
2026-01-28 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d985c33d-9829-530a-9c8b-8959e53de1a2 with scrape type 1
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d985c33d-9829-530a-9c8b-8959e53de1a2
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F794%252Fa5e4347684d04587bf15cf5777eccc89%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/794/a5e4347684d04587bf15cf5777eccc89/images/large/1.jpg not downloaded yet
2026-01-28 20:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 with identifier: 1878377
2026-01-28 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 with identifier: 1878377
2026-01-28 20:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2 with identifier: 1878377 to the API
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/094/a933fd2be16944c2a6637988afc68f3f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Clear',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 47713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2/ecaaa2d5-a7fd-54e9-bf11-f7ee0fe289a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/094/a933fd2be16944c2a6637988afc68f3f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878377%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [ayvens.es] INFO: Saving data for 1878377: {'created_time': 1769630484.45765, 'last_price_update_time': 1769630484.457662, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878377') HTTP/1.1" 204 0
2026-01-28 20:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 67b942cb-c9e7-5b66-ac6c-6389263fe639 with identifier: 1878378
2026-01-28 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 67b942cb-c9e7-5b66-ac6c-6389263fe639 with identifier: 1878378
2026-01-28 20:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 67b942cb-c9e7-5b66-ac6c-6389263fe639 with identifier: 1878378 to the API
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/534/2b0458043ba54ae3817619a5299b8987/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '67b942cb-c9e7-5b66-ac6c-6389263fe639',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 71959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b942cb-c9e7-5b66-ac6c-6389263fe639/67b942cb-c9e7-5b66-ac6c-6389263fe639_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/534/2b0458043ba54ae3817619a5299b8987/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878378%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [ayvens.es] INFO: Saving data for 1878378: {'created_time': 1769630484.931392, 'last_price_update_time': 1769630484.931418, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878378') HTTP/1.1" 204 0
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/729/49630b701a254a7d8eab8d9eb66fde4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/427/e400c3160ba8477a8e81dd5f5b74cd5e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [ayvens.es] INFO: Found listing with ID: 1878388
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878388%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [ayvens.es] INFO: Scrape type for 1878388: 1
2026-01-28 20:01:25 [ayvens.es] INFO: Extracting data for car ID: 1878388
2026-01-28 20:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e7ce514-d699-5d4a-89a8-0836527b1fc9 with identifier: 1878388
2026-01-28 20:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e7ce514-d699-5d4a-89a8-0836527b1fc9 with scrape type 1
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e7ce514-d699-5d4a-89a8-0836527b1fc9
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F666%252F177b4466f60647afb775f498a4bdf62e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/666/177b4466f60647afb775f498a4bdf62e/images/large/1.jpg not downloaded yet
2026-01-28 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/611/454e5a5effb8497da96e0ca9f3c04432/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9104d10>
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28dc35b2-292d-58d4-a3d6-7d6e7193e548/28dc35b2-292d-58d4-a3d6-7d6e7193e548_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252F2192310f70c6481dbc02d27f70d737fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/2192310f70c6481dbc02d27f70d737fc/images/large/1.jpg saved to cache
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28dc35b2-292d-58d4-a3d6-7d6e7193e548
2026-01-28 20:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28dc35b2-292d-58d4-a3d6-7d6e7193e548, skipping ID generation
2026-01-28 20:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28dc35b2-292d-58d4-a3d6-7d6e7193e548 with scrape type 1
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 28dc35b2-292d-58d4-a3d6-7d6e7193e548 from tracking dictionaries
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28dc35b2-292d-58d4-a3d6-7d6e7193e548 sending to next pipeline
2026-01-28 20:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 28dc35b2-292d-58d4-a3d6-7d6e7193e548, identifier: 1878379
2026-01-28 20:01:25 [ayvens.es] INFO: Found listing with ID: 1878389
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878389%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [ayvens.es] INFO: Scrape type for 1878389: 1
2026-01-28 20:01:25 [ayvens.es] INFO: Extracting data for car ID: 1878389
2026-01-28 20:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2e76993-bd39-5910-a395-5481bffd3cb2 with identifier: 1878389
2026-01-28 20:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2e76993-bd39-5910-a395-5481bffd3cb2 with scrape type 1
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c2e76993-bd39-5910-a395-5481bffd3cb2
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F770%252F9c66150caa4942fd91b2d93ab854382d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/770/9c66150caa4942fd91b2d93ab854382d/images/large/1.jpg not downloaded yet
2026-01-28 20:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 28dc35b2-292d-58d4-a3d6-7d6e7193e548 with identifier: 1878379
2026-01-28 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 28dc35b2-292d-58d4-a3d6-7d6e7193e548 with identifier: 1878379
2026-01-28 20:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 28dc35b2-292d-58d4-a3d6-7d6e7193e548 with identifier: 1878379 to the API
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/257/2192310f70c6481dbc02d27f70d737fc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '28dc35b2-292d-58d4-a3d6-7d6e7193e548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 124036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28dc35b2-292d-58d4-a3d6-7d6e7193e548/28dc35b2-292d-58d4-a3d6-7d6e7193e548_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/257/2192310f70c6481dbc02d27f70d737fc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Business Line BlueHDi 75KW (100CV)',
 'transmission': 'manual',
 'trim': 'SW Business Line BlueHDi 75KW (100CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878379%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [ayvens.es] INFO: Saving data for 1878379: {'created_time': 1769630485.863969, 'last_price_update_time': 1769630485.863981, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878379') HTTP/1.1" 204 0
2026-01-28 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/991/94551d477e0a406ba7f09b51080f17aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:25 [ayvens.es] INFO: Found listing with ID: 1878390
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878390%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [ayvens.es] INFO: Scrape type for 1878390: 1
2026-01-28 20:01:25 [ayvens.es] INFO: Extracting data for car ID: 1878390
2026-01-28 20:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98b3a36-bd6b-5d13-af15-8f12a049e7da with identifier: 1878390
2026-01-28 20:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98b3a36-bd6b-5d13-af15-8f12a049e7da with scrape type 1
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b98b3a36-bd6b-5d13-af15-8f12a049e7da
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252F08802f6f836c4c44961fd3e35b602781%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/08802f6f836c4c44961fd3e35b602781/images/large/1.jpg not downloaded yet
2026-01-28 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/577/764111f4089444dfa1ac433b17f7f9ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca863310>
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_739d25f1-1a59-5449-a12f-4b8de918ec6e/739d25f1-1a59-5449-a12f-4b8de918ec6e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F49630b701a254a7d8eab8d9eb66fde4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/49630b701a254a7d8eab8d9eb66fde4c/images/large/1.jpg saved to cache
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 739d25f1-1a59-5449-a12f-4b8de918ec6e
2026-01-28 20:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 739d25f1-1a59-5449-a12f-4b8de918ec6e, skipping ID generation
2026-01-28 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 739d25f1-1a59-5449-a12f-4b8de918ec6e with scrape type 1
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 739d25f1-1a59-5449-a12f-4b8de918ec6e from tracking dictionaries
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 739d25f1-1a59-5449-a12f-4b8de918ec6e sending to next pipeline
2026-01-28 20:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 739d25f1-1a59-5449-a12f-4b8de918ec6e, identifier: 1878381
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fdf090>
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dac4fa9-387e-5b04-855d-07f5f015ccac/9dac4fa9-387e-5b04-855d-07f5f015ccac_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F427%252Fe400c3160ba8477a8e81dd5f5b74cd5e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/427/e400c3160ba8477a8e81dd5f5b74cd5e/images/large/1.jpg saved to cache
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dac4fa9-387e-5b04-855d-07f5f015ccac
2026-01-28 20:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dac4fa9-387e-5b04-855d-07f5f015ccac, skipping ID generation
2026-01-28 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dac4fa9-387e-5b04-855d-07f5f015ccac with scrape type 1
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9dac4fa9-387e-5b04-855d-07f5f015ccac from tracking dictionaries
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dac4fa9-387e-5b04-855d-07f5f015ccac sending to next pipeline
2026-01-28 20:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9dac4fa9-387e-5b04-855d-07f5f015ccac, identifier: 1878380
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8a99d0>
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22bb86e1-7533-52bb-9a6c-bb80759e6f26/22bb86e1-7533-52bb-9a6c-bb80759e6f26_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252F454e5a5effb8497da96e0ca9f3c04432%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/454e5a5effb8497da96e0ca9f3c04432/images/large/1.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22bb86e1-7533-52bb-9a6c-bb80759e6f26
2026-01-28 20:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22bb86e1-7533-52bb-9a6c-bb80759e6f26, skipping ID generation
2026-01-28 20:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22bb86e1-7533-52bb-9a6c-bb80759e6f26 with scrape type 1
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 22bb86e1-7533-52bb-9a6c-bb80759e6f26 from tracking dictionaries
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22bb86e1-7533-52bb-9a6c-bb80759e6f26 sending to next pipeline
2026-01-28 20:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 22bb86e1-7533-52bb-9a6c-bb80759e6f26, identifier: 1878382
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/976/00b8719333524dbead3a892428e6d9a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [ayvens.es] INFO: Found listing with ID: 1878391
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878391%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [ayvens.es] INFO: Scrape type for 1878391: 1
2026-01-28 20:01:27 [ayvens.es] INFO: Extracting data for car ID: 1878391
2026-01-28 20:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fcc4628-b33f-5428-ae47-04e1ee57202d with identifier: 1878391
2026-01-28 20:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fcc4628-b33f-5428-ae47-04e1ee57202d with scrape type 1
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2fcc4628-b33f-5428-ae47-04e1ee57202d
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F1f3b2bb20f5647a4ab48cc0447366709%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/1f3b2bb20f5647a4ab48cc0447366709/images/large/1.jpg not downloaded yet
2026-01-28 20:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 739d25f1-1a59-5449-a12f-4b8de918ec6e with identifier: 1878381
2026-01-28 20:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 739d25f1-1a59-5449-a12f-4b8de918ec6e with identifier: 1878381
2026-01-28 20:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 739d25f1-1a59-5449-a12f-4b8de918ec6e with identifier: 1878381 to the API
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/729/49630b701a254a7d8eab8d9eb66fde4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '739d25f1-1a59-5449-a12f-4b8de918ec6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 119948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_739d25f1-1a59-5449-a12f-4b8de918ec6e/739d25f1-1a59-5449-a12f-4b8de918ec6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/729/49630b701a254a7d8eab8d9eb66fde4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel Pack',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878381%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [ayvens.es] INFO: Saving data for 1878381: {'created_time': 1769630487.772208, 'last_price_update_time': 1769630487.772219, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878381') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9dac4fa9-387e-5b04-855d-07f5f015ccac with identifier: 1878380
2026-01-28 20:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9dac4fa9-387e-5b04-855d-07f5f015ccac with identifier: 1878380
2026-01-28 20:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9dac4fa9-387e-5b04-855d-07f5f015ccac with identifier: 1878380 to the API
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/427/e400c3160ba8477a8e81dd5f5b74cd5e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9dac4fa9-387e-5b04-855d-07f5f015ccac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 99994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dac4fa9-387e-5b04-855d-07f5f015ccac/9dac4fa9-387e-5b04-855d-07f5f015ccac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/427/e400c3160ba8477a8e81dd5f5b74cd5e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW Reference Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW Reference Eco',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878380%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [ayvens.es] INFO: Saving data for 1878380: {'created_time': 1769630488.316838, 'last_price_update_time': 1769630488.316849, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878380') HTTP/1.1" 204 0
2026-01-28 20:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 22bb86e1-7533-52bb-9a6c-bb80759e6f26 with identifier: 1878382
2026-01-28 20:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 22bb86e1-7533-52bb-9a6c-bb80759e6f26 with identifier: 1878382
2026-01-28 20:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 22bb86e1-7533-52bb-9a6c-bb80759e6f26 with identifier: 1878382 to the API
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/611/454e5a5effb8497da96e0ca9f3c04432/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '22bb86e1-7533-52bb-9a6c-bb80759e6f26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 54330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22bb86e1-7533-52bb-9a6c-bb80759e6f26/22bb86e1-7533-52bb-9a6c-bb80759e6f26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/611/454e5a5effb8497da96e0ca9f3c04432/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.5 TSI 110kW DSG S&S Style Go',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW DSG S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878382%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [ayvens.es] INFO: Saving data for 1878382: {'created_time': 1769630488.90504, 'last_price_update_time': 1769630488.90505, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878382') HTTP/1.1" 204 0
2026-01-28 20:01:28 [ayvens.es] INFO: Found listing with ID: 1878392
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878392%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [ayvens.es] INFO: Scrape type for 1878392: 1
2026-01-28 20:01:29 [ayvens.es] INFO: Extracting data for car ID: 1878392
2026-01-28 20:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e74afc-2f0a-5d49-93f2-4ddea0c97718 with identifier: 1878392
2026-01-28 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e74afc-2f0a-5d49-93f2-4ddea0c97718 with scrape type 1
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 44e74afc-2f0a-5d49-93f2-4ddea0c97718
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fcba0eadf42944d228c772c62c42b13f1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/cba0eadf42944d228c772c62c42b13f1/images/large/1.jpg not downloaded yet
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca852390>
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc014a2-c74d-5bd2-93d4-2a5f0153b246/0cc014a2-c74d-5bd2-93d4-2a5f0153b246_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252F94551d477e0a406ba7f09b51080f17aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/94551d477e0a406ba7f09b51080f17aa/images/large/1.jpg saved to cache
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cc014a2-c74d-5bd2-93d4-2a5f0153b246
2026-01-28 20:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cc014a2-c74d-5bd2-93d4-2a5f0153b246, skipping ID generation
2026-01-28 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 with scrape type 1
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 from tracking dictionaries
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 sending to next pipeline
2026-01-28 20:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0cc014a2-c74d-5bd2-93d4-2a5f0153b246, identifier: 1878384
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca852950>
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8cb940-3e1b-5908-aa23-08328534cb2e/ea8cb940-3e1b-5908-aa23-08328534cb2e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F577%252F764111f4089444dfa1ac433b17f7f9ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/577/764111f4089444dfa1ac433b17f7f9ad/images/large/1.jpg saved to cache
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea8cb940-3e1b-5908-aa23-08328534cb2e
2026-01-28 20:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea8cb940-3e1b-5908-aa23-08328534cb2e, skipping ID generation
2026-01-28 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8cb940-3e1b-5908-aa23-08328534cb2e with scrape type 1
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ea8cb940-3e1b-5908-aa23-08328534cb2e from tracking dictionaries
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea8cb940-3e1b-5908-aa23-08328534cb2e sending to next pipeline
2026-01-28 20:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ea8cb940-3e1b-5908-aa23-08328534cb2e, identifier: 1878385
2026-01-28 20:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 with identifier: 1878384
2026-01-28 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 with identifier: 1878384
2026-01-28 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188505 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188505
2026-01-28 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 spider: ayvens.es
2026-01-28 20:01:30 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0cc014a2-c74d-5bd2-93d4-2a5f0153b246 due to rule: high_mileage_for_country.json, error: 188505 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188505
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0cc014a2-c74d-5bd2-93d4-2a5f0153b246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AURIS',
 'odometer': 188505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc014a2-c74d-5bd2-93d4-2a5f0153b246/0cc014a2-c74d-5bd2-93d4-2a5f0153b246_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/991/94551d477e0a406ba7f09b51080f17aa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA AURIS 1.4 90D Business',
 'transmission': 'manual',
 'trim': '1.4 90D Business',
 'vin': None,
 'year': 2016}
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878384%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [ayvens.es] INFO: Saving data for 1878384: {'created_time': 1769630490.305331, 'last_price_update_time': 1769630490.305342, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878384') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ea8cb940-3e1b-5908-aa23-08328534cb2e with identifier: 1878385
2026-01-28 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ea8cb940-3e1b-5908-aa23-08328534cb2e with identifier: 1878385
2026-01-28 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-28 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ea8cb940-3e1b-5908-aa23-08328534cb2e spider: ayvens.es
2026-01-28 20:01:30 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ea8cb940-3e1b-5908-aa23-08328534cb2e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ea8cb940-3e1b-5908-aa23-08328534cb2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 128294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8cb940-3e1b-5908-aa23-08328534cb2e/ea8cb940-3e1b-5908-aa23-08328534cb2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/577/764111f4089444dfa1ac433b17f7f9ad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L2H1 dCi 88kW (120CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Furgon 29 L2H1 dCi 88kW (120CV) Euro 6',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878385%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [ayvens.es] INFO: Saving data for 1878385: {'created_time': 1769630490.594835, 'last_price_update_time': 1769630490.594844, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878385') HTTP/1.1" 204 0
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca875610>
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0792b02a-c407-5da2-b3c2-e71d0ddc0a68/0792b02a-c407-5da2-b3c2-e71d0ddc0a68_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F976%252F00b8719333524dbead3a892428e6d9a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/976/00b8719333524dbead3a892428e6d9a2/images/large/1.jpg saved to cache
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0792b02a-c407-5da2-b3c2-e71d0ddc0a68
2026-01-28 20:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0792b02a-c407-5da2-b3c2-e71d0ddc0a68, skipping ID generation
2026-01-28 20:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 with scrape type 1
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 from tracking dictionaries
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 sending to next pipeline
2026-01-28 20:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0792b02a-c407-5da2-b3c2-e71d0ddc0a68, identifier: 1878383
2026-01-28 20:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/722/9e9c7b2875f14ef89aa46a434c4f6372/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:31 [ayvens.es] INFO: Found listing with ID: 1878393
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878393%27 HTTP/1.1" 200 None
2026-01-28 20:01:31 [ayvens.es] INFO: Scrape type for 1878393: 1
2026-01-28 20:01:31 [ayvens.es] INFO: Extracting data for car ID: 1878393
2026-01-28 20:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 with identifier: 1878393
2026-01-28 20:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 with scrape type 1
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F089%252Fcb3703d9e9614f348be957327e204568%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/089/cb3703d9e9614f348be957327e204568/images/large/1.jpg not downloaded yet
2026-01-28 20:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 with identifier: 1878383
2026-01-28 20:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 with identifier: 1878383
2026-01-28 20:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0792b02a-c407-5da2-b3c2-e71d0ddc0a68 with identifier: 1878383 to the API
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/976/00b8719333524dbead3a892428e6d9a2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0792b02a-c407-5da2-b3c2-e71d0ddc0a68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 36056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0792b02a-c407-5da2-b3c2-e71d0ddc0a68/0792b02a-c407-5da2-b3c2-e71d0ddc0a68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/976/00b8719333524dbead3a892428e6d9a2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878383%27 HTTP/1.1" 200 None
2026-01-28 20:01:31 [ayvens.es] INFO: Saving data for 1878383: {'created_time': 1769630491.960924, 'last_price_update_time': 1769630491.960936, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878383') HTTP/1.1" 204 0
2026-01-28 20:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/666/177b4466f60647afb775f498a4bdf62e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:31 [ayvens.es] INFO: Found listing with ID: 1878394
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878394%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [ayvens.es] INFO: Scrape type for 1878394: 1
2026-01-28 20:01:32 [ayvens.es] INFO: Extracting data for car ID: 1878394
2026-01-28 20:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2263a50-4eac-5800-b695-b5d8798ae365 with identifier: 1878394
2026-01-28 20:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2263a50-4eac-5800-b695-b5d8798ae365 with scrape type 1
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2263a50-4eac-5800-b695-b5d8798ae365
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F042%252Fabe3144dc78341abbd7e1fbf1ae00a95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/042/abe3144dc78341abbd7e1fbf1ae00a95/images/large/1.jpg not downloaded yet
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81caa34290>
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e834ba3-fa32-52ae-9a83-6883889b2a9a/9e834ba3-fa32-52ae-9a83-6883889b2a9a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F9e9c7b2875f14ef89aa46a434c4f6372%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/9e9c7b2875f14ef89aa46a434c4f6372/images/large/1.jpg saved to cache
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e834ba3-fa32-52ae-9a83-6883889b2a9a
2026-01-28 20:01:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e834ba3-fa32-52ae-9a83-6883889b2a9a, skipping ID generation
2026-01-28 20:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e834ba3-fa32-52ae-9a83-6883889b2a9a with scrape type 1
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9e834ba3-fa32-52ae-9a83-6883889b2a9a from tracking dictionaries
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e834ba3-fa32-52ae-9a83-6883889b2a9a sending to next pipeline
2026-01-28 20:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9e834ba3-fa32-52ae-9a83-6883889b2a9a, identifier: 1878386
2026-01-28 20:01:32 [ayvens.es] INFO: Found listing with ID: 1878395
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878395%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [ayvens.es] INFO: Scrape type for 1878395: 1
2026-01-28 20:01:32 [ayvens.es] INFO: Extracting data for car ID: 1878395
2026-01-28 20:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e175b7d-c029-5052-919f-275f7d7751bd with identifier: 1878395
2026-01-28 20:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e175b7d-c029-5052-919f-275f7d7751bd with scrape type 1
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e175b7d-c029-5052-919f-275f7d7751bd
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fdf204eeaf6104ed4abdacb60736a2f26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/df204eeaf6104ed4abdacb60736a2f26/images/large/1.jpg not downloaded yet
2026-01-28 20:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9e834ba3-fa32-52ae-9a83-6883889b2a9a with identifier: 1878386
2026-01-28 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9e834ba3-fa32-52ae-9a83-6883889b2a9a with identifier: 1878386
2026-01-28 20:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9e834ba3-fa32-52ae-9a83-6883889b2a9a with identifier: 1878386 to the API
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/722/9e9c7b2875f14ef89aa46a434c4f6372/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9e834ba3-fa32-52ae-9a83-6883889b2a9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 81134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e834ba3-fa32-52ae-9a83-6883889b2a9a/9e834ba3-fa32-52ae-9a83-6883889b2a9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/722/9e9c7b2875f14ef89aa46a434c4f6372/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.5D DT 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.5D DT 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878386%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [ayvens.es] INFO: Saving data for 1878386: {'created_time': 1769630493.002145, 'last_price_update_time': 1769630493.002156, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878386') HTTP/1.1" 204 0
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/770/9c66150caa4942fd91b2d93ab854382d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/723/08802f6f836c4c44961fd3e35b602781/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/794/a5e4347684d04587bf15cf5777eccc89/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:33 [ayvens.es] INFO: Found listing with ID: 1878396
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878396%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [ayvens.es] INFO: Scrape type for 1878396: 1
2026-01-28 20:01:33 [ayvens.es] INFO: Extracting data for car ID: 1878396
2026-01-28 20:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27db2065-eda4-531c-9848-eb3e8b2388dd with identifier: 1878396
2026-01-28 20:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27db2065-eda4-531c-9848-eb3e8b2388dd with scrape type 1
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 27db2065-eda4-531c-9848-eb3e8b2388dd
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F96dba9923f1b4228928abedcd9c381ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/96dba9923f1b4228928abedcd9c381ba/images/large/1.jpg not downloaded yet
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81caa35710>
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e7ce514-d699-5d4a-89a8-0836527b1fc9/3e7ce514-d699-5d4a-89a8-0836527b1fc9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F666%252F177b4466f60647afb775f498a4bdf62e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/666/177b4466f60647afb775f498a4bdf62e/images/large/1.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e7ce514-d699-5d4a-89a8-0836527b1fc9
2026-01-28 20:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e7ce514-d699-5d4a-89a8-0836527b1fc9, skipping ID generation
2026-01-28 20:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e7ce514-d699-5d4a-89a8-0836527b1fc9 with scrape type 1
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3e7ce514-d699-5d4a-89a8-0836527b1fc9 from tracking dictionaries
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e7ce514-d699-5d4a-89a8-0836527b1fc9 sending to next pipeline
2026-01-28 20:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e7ce514-d699-5d4a-89a8-0836527b1fc9, identifier: 1878388
2026-01-28 20:01:33 [ayvens.es] INFO: Found listing with ID: 1878397
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878397%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [ayvens.es] INFO: Scrape type for 1878397: 1
2026-01-28 20:01:33 [ayvens.es] INFO: Extracting data for car ID: 1878397
2026-01-28 20:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cbcefc8-edcc-5f9d-b101-ba0134980872 with identifier: 1878397
2026-01-28 20:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cbcefc8-edcc-5f9d-b101-ba0134980872 with scrape type 1
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1cbcefc8-edcc-5f9d-b101-ba0134980872
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252F1f37386c6e0b4a21a473ff311d9ec02f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/1f37386c6e0b4a21a473ff311d9ec02f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e7ce514-d699-5d4a-89a8-0836527b1fc9 with identifier: 1878388
2026-01-28 20:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e7ce514-d699-5d4a-89a8-0836527b1fc9 with identifier: 1878388
2026-01-28 20:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e7ce514-d699-5d4a-89a8-0836527b1fc9 with identifier: 1878388 to the API
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/666/177b4466f60647afb775f498a4bdf62e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e7ce514-d699-5d4a-89a8-0836527b1fc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 58942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7ce514-d699-5d4a-89a8-0836527b1fc9/3e7ce514-d699-5d4a-89a8-0836527b1fc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/666/177b4466f60647afb775f498a4bdf62e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi 132kW (180CV) Auto. SO CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 132kW (180CV) Auto. SO CHIC',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878388%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [ayvens.es] INFO: Saving data for 1878388: {'created_time': 1769630493.958326, 'last_price_update_time': 1769630493.958335, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878388') HTTP/1.1" 204 0
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/418/1f3b2bb20f5647a4ab48cc0447366709/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [ayvens.es] INFO: Found listing with ID: 1878398
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878398%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [ayvens.es] INFO: Scrape type for 1878398: 1
2026-01-28 20:01:34 [ayvens.es] INFO: Extracting data for car ID: 1878398
2026-01-28 20:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3760dbf-cb57-5878-91ca-91cdeff9d1c6 with identifier: 1878398
2026-01-28 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3760dbf-cb57-5878-91ca-91cdeff9d1c6 with scrape type 1
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3760dbf-cb57-5878-91ca-91cdeff9d1c6
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F8c393ea42afb49ce8e16324f50ce29a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/8c393ea42afb49ce8e16324f50ce29a1/images/large/1.jpg not downloaded yet
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9143010>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2e76993-bd39-5910-a395-5481bffd3cb2/c2e76993-bd39-5910-a395-5481bffd3cb2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F770%252F9c66150caa4942fd91b2d93ab854382d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/770/9c66150caa4942fd91b2d93ab854382d/images/large/1.jpg saved to cache
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2e76993-bd39-5910-a395-5481bffd3cb2
2026-01-28 20:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2e76993-bd39-5910-a395-5481bffd3cb2, skipping ID generation
2026-01-28 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2e76993-bd39-5910-a395-5481bffd3cb2 with scrape type 1
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c2e76993-bd39-5910-a395-5481bffd3cb2 from tracking dictionaries
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2e76993-bd39-5910-a395-5481bffd3cb2 sending to next pipeline
2026-01-28 20:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c2e76993-bd39-5910-a395-5481bffd3cb2, identifier: 1878389
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca243990>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98b3a36-bd6b-5d13-af15-8f12a049e7da/b98b3a36-bd6b-5d13-af15-8f12a049e7da_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252F08802f6f836c4c44961fd3e35b602781%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/08802f6f836c4c44961fd3e35b602781/images/large/1.jpg saved to cache
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b98b3a36-bd6b-5d13-af15-8f12a049e7da
2026-01-28 20:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b98b3a36-bd6b-5d13-af15-8f12a049e7da, skipping ID generation
2026-01-28 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98b3a36-bd6b-5d13-af15-8f12a049e7da with scrape type 1
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b98b3a36-bd6b-5d13-af15-8f12a049e7da from tracking dictionaries
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b98b3a36-bd6b-5d13-af15-8f12a049e7da sending to next pipeline
2026-01-28 20:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b98b3a36-bd6b-5d13-af15-8f12a049e7da, identifier: 1878390
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81caa351d0>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d985c33d-9829-530a-9c8b-8959e53de1a2/d985c33d-9829-530a-9c8b-8959e53de1a2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F794%252Fa5e4347684d04587bf15cf5777eccc89%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/794/a5e4347684d04587bf15cf5777eccc89/images/large/1.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d985c33d-9829-530a-9c8b-8959e53de1a2
2026-01-28 20:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d985c33d-9829-530a-9c8b-8959e53de1a2, skipping ID generation
2026-01-28 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d985c33d-9829-530a-9c8b-8959e53de1a2 with scrape type 1
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d985c33d-9829-530a-9c8b-8959e53de1a2 from tracking dictionaries
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d985c33d-9829-530a-9c8b-8959e53de1a2 sending to next pipeline
2026-01-28 20:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d985c33d-9829-530a-9c8b-8959e53de1a2, identifier: 1878387
2026-01-28 20:01:35 [ayvens.es] INFO: Found listing with ID: 1878399
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878399%27 HTTP/1.1" 200 None
2026-01-28 20:01:35 [ayvens.es] INFO: Scrape type for 1878399: 1
2026-01-28 20:01:35 [ayvens.es] INFO: Extracting data for car ID: 1878399
2026-01-28 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f52cd851-0f38-5abc-8ad0-75c04ee267c7 with identifier: 1878399
2026-01-28 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52cd851-0f38-5abc-8ad0-75c04ee267c7 with scrape type 1
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f52cd851-0f38-5abc-8ad0-75c04ee267c7
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F270%252Ff6a8226410684513b15655c55771d465%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/270/f6a8226410684513b15655c55771d465/images/large/1.jpg not downloaded yet
2026-01-28 20:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c2e76993-bd39-5910-a395-5481bffd3cb2 with identifier: 1878389
2026-01-28 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c2e76993-bd39-5910-a395-5481bffd3cb2 with identifier: 1878389
2026-01-28 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155646
2026-01-28 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c2e76993-bd39-5910-a395-5481bffd3cb2 spider: ayvens.es
2026-01-28 20:01:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c2e76993-bd39-5910-a395-5481bffd3cb2 due to rule: high_mileage_for_country.json, error: 155646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155646
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c2e76993-bd39-5910-a395-5481bffd3cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 155646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2e76993-bd39-5910-a395-5481bffd3cb2/c2e76993-bd39-5910-a395-5481bffd3cb2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/770/9c66150caa4942fd91b2d93ab854382d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV) DSG Variant',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) DSG Variant',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878389%27 HTTP/1.1" 200 None
2026-01-28 20:01:35 [ayvens.es] INFO: Saving data for 1878389: {'created_time': 1769630495.927033, 'last_price_update_time': 1769630495.927042, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878389') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b98b3a36-bd6b-5d13-af15-8f12a049e7da with identifier: 1878390
2026-01-28 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b98b3a36-bd6b-5d13-af15-8f12a049e7da with identifier: 1878390
2026-01-28 20:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b98b3a36-bd6b-5d13-af15-8f12a049e7da with identifier: 1878390 to the API
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/723/08802f6f836c4c44961fd3e35b602781/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b98b3a36-bd6b-5d13-af15-8f12a049e7da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 54510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98b3a36-bd6b-5d13-af15-8f12a049e7da/b98b3a36-bd6b-5d13-af15-8f12a049e7da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/723/08802f6f836c4c44961fd3e35b602781/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 2.0 BlueHDi 133kW S&S GT Pack EAT8',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi 133kW S&S GT Pack EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878390%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [ayvens.es] INFO: Saving data for 1878390: {'created_time': 1769630496.35302, 'last_price_update_time': 1769630496.353031, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878390') HTTP/1.1" 204 0
2026-01-28 20:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d985c33d-9829-530a-9c8b-8959e53de1a2 with identifier: 1878387
2026-01-28 20:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d985c33d-9829-530a-9c8b-8959e53de1a2 with identifier: 1878387
2026-01-28 20:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d985c33d-9829-530a-9c8b-8959e53de1a2 with identifier: 1878387 to the API
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/794/a5e4347684d04587bf15cf5777eccc89/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd985c33d-9829-530a-9c8b-8959e53de1a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 104148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d985c33d-9829-530a-9c8b-8959e53de1a2/d985c33d-9829-530a-9c8b-8959e53de1a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/794/a5e4347684d04587bf15cf5777eccc89/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Zen Energy dCi 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Zen Energy dCi 81kW (110CV)',
 'vin': None,
 'year': 2018}
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878387%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [ayvens.es] INFO: Saving data for 1878387: {'created_time': 1769630496.802253, 'last_price_update_time': 1769630496.802266, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878387') HTTP/1.1" 204 0
2026-01-28 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/cba0eadf42944d228c772c62c42b13f1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/042/abe3144dc78341abbd7e1fbf1ae00a95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/089/cb3703d9e9614f348be957327e204568/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:36 [ayvens.es] INFO: Found listing with ID: 1878400
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878400%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [ayvens.es] INFO: Scrape type for 1878400: 1
2026-01-28 20:01:36 [ayvens.es] INFO: Extracting data for car ID: 1878400
2026-01-28 20:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 714a45d2-9eba-53b7-be88-ae20e24ee54d with identifier: 1878400
2026-01-28 20:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714a45d2-9eba-53b7-be88-ae20e24ee54d with scrape type 1
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 714a45d2-9eba-53b7-be88-ae20e24ee54d
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Ff4942a7ad6974dfa940b506e62da8274%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/f4942a7ad6974dfa940b506e62da8274/images/large/1.jpg not downloaded yet
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca667210>
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fcc4628-b33f-5428-ae47-04e1ee57202d/2fcc4628-b33f-5428-ae47-04e1ee57202d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F1f3b2bb20f5647a4ab48cc0447366709%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/1f3b2bb20f5647a4ab48cc0447366709/images/large/1.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fcc4628-b33f-5428-ae47-04e1ee57202d
2026-01-28 20:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fcc4628-b33f-5428-ae47-04e1ee57202d, skipping ID generation
2026-01-28 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fcc4628-b33f-5428-ae47-04e1ee57202d with scrape type 1
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2fcc4628-b33f-5428-ae47-04e1ee57202d from tracking dictionaries
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fcc4628-b33f-5428-ae47-04e1ee57202d sending to next pipeline
2026-01-28 20:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2fcc4628-b33f-5428-ae47-04e1ee57202d, identifier: 1878391
2026-01-28 20:01:37 [ayvens.es] INFO: Found listing with ID: 1878401
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878401%27 HTTP/1.1" 200 None
2026-01-28 20:01:37 [ayvens.es] INFO: Scrape type for 1878401: 1
2026-01-28 20:01:37 [ayvens.es] INFO: Extracting data for car ID: 1878401
2026-01-28 20:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264f2aae-720d-59f8-8566-a58a7ba10bd5 with identifier: 1878401
2026-01-28 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264f2aae-720d-59f8-8566-a58a7ba10bd5 with scrape type 1
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 264f2aae-720d-59f8-8566-a58a7ba10bd5
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F9d36ceaa4c5b442bada4ccbe89c26d36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/9d36ceaa4c5b442bada4ccbe89c26d36/images/large/1.jpg not downloaded yet
2026-01-28 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2fcc4628-b33f-5428-ae47-04e1ee57202d with identifier: 1878391
2026-01-28 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2fcc4628-b33f-5428-ae47-04e1ee57202d with identifier: 1878391
2026-01-28 20:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2fcc4628-b33f-5428-ae47-04e1ee57202d with identifier: 1878391 to the API
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/418/1f3b2bb20f5647a4ab48cc0447366709/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2fcc4628-b33f-5428-ae47-04e1ee57202d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 50271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fcc4628-b33f-5428-ae47-04e1ee57202d/2fcc4628-b33f-5428-ae47-04e1ee57202d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/418/1f3b2bb20f5647a4ab48cc0447366709/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878391%27 HTTP/1.1" 200 None
2026-01-28 20:01:37 [ayvens.es] INFO: Saving data for 1878391: {'created_time': 1769630497.797029, 'last_price_update_time': 1769630497.797041, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878391') HTTP/1.1" 204 0
2026-01-28 20:01:37 [ayvens.es] INFO: Found listing with ID: 1878402
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878402%27 HTTP/1.1" 200 None
2026-01-28 20:01:37 [ayvens.es] INFO: Scrape type for 1878402: 1
2026-01-28 20:01:37 [ayvens.es] INFO: Extracting data for car ID: 1878402
2026-01-28 20:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da4c2874-4f0d-50e4-b01e-3cc4fb605a0a with identifier: 1878402
2026-01-28 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da4c2874-4f0d-50e4-b01e-3cc4fb605a0a with scrape type 1
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da4c2874-4f0d-50e4-b01e-3cc4fb605a0a
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252F9dd53da761c84b48a0ff7c0a518dae13%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/9dd53da761c84b48a0ff7c0a518dae13/images/large/1.jpg not downloaded yet
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c901bad0>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e74afc-2f0a-5d49-93f2-4ddea0c97718/44e74afc-2f0a-5d49-93f2-4ddea0c97718_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fcba0eadf42944d228c772c62c42b13f1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/cba0eadf42944d228c772c62c42b13f1/images/large/1.jpg saved to cache
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44e74afc-2f0a-5d49-93f2-4ddea0c97718
2026-01-28 20:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44e74afc-2f0a-5d49-93f2-4ddea0c97718, skipping ID generation
2026-01-28 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e74afc-2f0a-5d49-93f2-4ddea0c97718 with scrape type 1
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 44e74afc-2f0a-5d49-93f2-4ddea0c97718 from tracking dictionaries
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44e74afc-2f0a-5d49-93f2-4ddea0c97718 sending to next pipeline
2026-01-28 20:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 44e74afc-2f0a-5d49-93f2-4ddea0c97718, identifier: 1878392
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fe8650>
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2263a50-4eac-5800-b695-b5d8798ae365/b2263a50-4eac-5800-b695-b5d8798ae365_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F042%252Fabe3144dc78341abbd7e1fbf1ae00a95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/042/abe3144dc78341abbd7e1fbf1ae00a95/images/large/1.jpg saved to cache
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2263a50-4eac-5800-b695-b5d8798ae365
2026-01-28 20:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2263a50-4eac-5800-b695-b5d8798ae365, skipping ID generation
2026-01-28 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2263a50-4eac-5800-b695-b5d8798ae365 with scrape type 1
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2263a50-4eac-5800-b695-b5d8798ae365 from tracking dictionaries
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2263a50-4eac-5800-b695-b5d8798ae365 sending to next pipeline
2026-01-28 20:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2263a50-4eac-5800-b695-b5d8798ae365, identifier: 1878394
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca89cb10>
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62935f97-7c1e-5fbb-8b42-ab32ec2bbf00/62935f97-7c1e-5fbb-8b42-ab32ec2bbf00_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F089%252Fcb3703d9e9614f348be957327e204568%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/089/cb3703d9e9614f348be957327e204568/images/large/1.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00
2026-01-28 20:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00, skipping ID generation
2026-01-28 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 with scrape type 1
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 from tracking dictionaries
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 sending to next pipeline
2026-01-28 20:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00, identifier: 1878393
2026-01-28 20:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 44e74afc-2f0a-5d49-93f2-4ddea0c97718 with identifier: 1878392
2026-01-28 20:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 44e74afc-2f0a-5d49-93f2-4ddea0c97718 with identifier: 1878392
2026-01-28 20:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 44e74afc-2f0a-5d49-93f2-4ddea0c97718 with identifier: 1878392 to the API
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/cba0eadf42944d228c772c62c42b13f1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '44e74afc-2f0a-5d49-93f2-4ddea0c97718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 31575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e74afc-2f0a-5d49-93f2-4ddea0c97718/44e74afc-2f0a-5d49-93f2-4ddea0c97718_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/cba0eadf42944d228c772c62c42b13f1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878392%27 HTTP/1.1" 200 None
2026-01-28 20:01:39 [ayvens.es] INFO: Saving data for 1878392: {'created_time': 1769630499.612955, 'last_price_update_time': 1769630499.612968, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878392') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2263a50-4eac-5800-b695-b5d8798ae365 with identifier: 1878394
2026-01-28 20:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2263a50-4eac-5800-b695-b5d8798ae365 with identifier: 1878394
2026-01-28 20:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2263a50-4eac-5800-b695-b5d8798ae365 with identifier: 1878394 to the API
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/042/abe3144dc78341abbd7e1fbf1ae00a95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2263a50-4eac-5800-b695-b5d8798ae365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 62453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2263a50-4eac-5800-b695-b5d8798ae365/b2263a50-4eac-5800-b695-b5d8798ae365_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/042/abe3144dc78341abbd7e1fbf1ae00a95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878394%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [ayvens.es] INFO: Saving data for 1878394: {'created_time': 1769630500.009246, 'last_price_update_time': 1769630500.009258, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878394') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 with identifier: 1878393
2026-01-28 20:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 with identifier: 1878393
2026-01-28 20:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 62935f97-7c1e-5fbb-8b42-ab32ec2bbf00 with identifier: 1878393 to the API
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/089/cb3703d9e9614f348be957327e204568/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '62935f97-7c1e-5fbb-8b42-ab32ec2bbf00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 101467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62935f97-7c1e-5fbb-8b42-ab32ec2bbf00/62935f97-7c1e-5fbb-8b42-ab32ec2bbf00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/089/cb3703d9e9614f348be957327e204568/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878393%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [ayvens.es] INFO: Saving data for 1878393: {'created_time': 1769630500.403831, 'last_price_update_time': 1769630500.403845, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878393') HTTP/1.1" 204 0
2026-01-28 20:01:40 [ayvens.es] INFO: Found listing with ID: 1878403
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878403%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [ayvens.es] INFO: Scrape type for 1878403: 1
2026-01-28 20:01:40 [ayvens.es] INFO: Extracting data for car ID: 1878403
2026-01-28 20:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 with identifier: 1878403
2026-01-28 20:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 with scrape type 1
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F097%252F555f5d14f0d741df9f812f0c70f67b9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg not downloaded yet
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/543/96dba9923f1b4228928abedcd9c381ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/425/df204eeaf6104ed4abdacb60736a2f26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:40 [ayvens.es] INFO: Found listing with ID: 1878404
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878404%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [ayvens.es] INFO: Scrape type for 1878404: 1
2026-01-28 20:01:40 [ayvens.es] INFO: Extracting data for car ID: 1878404
2026-01-28 20:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70bffde6-f1dd-5341-b8ef-88529a892d50 with identifier: 1878404
2026-01-28 20:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70bffde6-f1dd-5341-b8ef-88529a892d50 with scrape type 1
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70bffde6-f1dd-5341-b8ef-88529a892d50
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F373%252F820b15bb488b456e93f5a542e829a92b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg not downloaded yet
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/047/1f37386c6e0b4a21a473ff311d9ec02f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/260/8c393ea42afb49ce8e16324f50ce29a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:40 [ayvens.es] INFO: Found listing with ID: 1878405
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878405%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [ayvens.es] INFO: Scrape type for 1878405: 1
2026-01-28 20:01:40 [ayvens.es] INFO: Extracting data for car ID: 1878405
2026-01-28 20:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404dd200-33eb-52cc-adda-01728d3b2175 with identifier: 1878405
2026-01-28 20:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404dd200-33eb-52cc-adda-01728d3b2175 with scrape type 1
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 404dd200-33eb-52cc-adda-01728d3b2175
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F498%252F86365062cb614fd1bfd193c6da789bfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/498/86365062cb614fd1bfd193c6da789bfe/images/large/1.jpg not downloaded yet
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/469/f4942a7ad6974dfa940b506e62da8274/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:40 [ayvens.es] INFO: Found listing with ID: 1878406
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878406%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [ayvens.es] INFO: Scrape type for 1878406: 1
2026-01-28 20:01:40 [ayvens.es] INFO: Extracting data for car ID: 1878406
2026-01-28 20:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3acf7f32-18b1-5891-a3e2-31c87acfaf16 with identifier: 1878406
2026-01-28 20:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3acf7f32-18b1-5891-a3e2-31c87acfaf16 with scrape type 1
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3acf7f32-18b1-5891-a3e2-31c87acfaf16
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252Fb5f30623cec04bc09de1e5ba575b1d6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/b5f30623cec04bc09de1e5ba575b1d6d/images/large/1.jpg not downloaded yet
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9163ed0>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27db2065-eda4-531c-9848-eb3e8b2388dd/27db2065-eda4-531c-9848-eb3e8b2388dd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F96dba9923f1b4228928abedcd9c381ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/96dba9923f1b4228928abedcd9c381ba/images/large/1.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27db2065-eda4-531c-9848-eb3e8b2388dd
2026-01-28 20:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27db2065-eda4-531c-9848-eb3e8b2388dd, skipping ID generation
2026-01-28 20:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27db2065-eda4-531c-9848-eb3e8b2388dd with scrape type 1
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 27db2065-eda4-531c-9848-eb3e8b2388dd from tracking dictionaries
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27db2065-eda4-531c-9848-eb3e8b2388dd sending to next pipeline
2026-01-28 20:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 27db2065-eda4-531c-9848-eb3e8b2388dd, identifier: 1878396
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca27e550>
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e175b7d-c029-5052-919f-275f7d7751bd/4e175b7d-c029-5052-919f-275f7d7751bd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fdf204eeaf6104ed4abdacb60736a2f26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/df204eeaf6104ed4abdacb60736a2f26/images/large/1.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e175b7d-c029-5052-919f-275f7d7751bd
2026-01-28 20:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e175b7d-c029-5052-919f-275f7d7751bd, skipping ID generation
2026-01-28 20:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e175b7d-c029-5052-919f-275f7d7751bd with scrape type 1
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4e175b7d-c029-5052-919f-275f7d7751bd from tracking dictionaries
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e175b7d-c029-5052-919f-275f7d7751bd sending to next pipeline
2026-01-28 20:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e175b7d-c029-5052-919f-275f7d7751bd, identifier: 1878395
2026-01-28 20:01:41 [ayvens.es] INFO: Found listing with ID: 1878407
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878407%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [ayvens.es] INFO: Scrape type for 1878407: 1
2026-01-28 20:01:41 [ayvens.es] INFO: Extracting data for car ID: 1878407
2026-01-28 20:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70433497-f646-55dc-8efa-7b88fb5a574c with identifier: 1878407
2026-01-28 20:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70433497-f646-55dc-8efa-7b88fb5a574c with scrape type 1
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70433497-f646-55dc-8efa-7b88fb5a574c
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F662%252F80aef0cf5b6a4b7cbbeabfd30523fa00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/662/80aef0cf5b6a4b7cbbeabfd30523fa00/images/large/1.jpg not downloaded yet
2026-01-28 20:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 27db2065-eda4-531c-9848-eb3e8b2388dd with identifier: 1878396
2026-01-28 20:01:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 27db2065-eda4-531c-9848-eb3e8b2388dd with identifier: 1878396
2026-01-28 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175252 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175252
2026-01-28 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 27db2065-eda4-531c-9848-eb3e8b2388dd spider: ayvens.es
2026-01-28 20:01:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 27db2065-eda4-531c-9848-eb3e8b2388dd due to rule: high_mileage_for_country.json, error: 175252 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175252
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Saphirschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '27db2065-eda4-531c-9848-eb3e8b2388dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 175252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27db2065-eda4-531c-9848-eb3e8b2388dd/27db2065-eda4-531c-9848-eb3e8b2388dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/543/96dba9923f1b4228928abedcd9c381ba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878396%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [ayvens.es] INFO: Saving data for 1878396: {'created_time': 1769630502.010086, 'last_price_update_time': 1769630502.0101, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878396') HTTP/1.1" 204 0
2026-01-28 20:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e175b7d-c029-5052-919f-275f7d7751bd with identifier: 1878395
2026-01-28 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e175b7d-c029-5052-919f-275f7d7751bd with identifier: 1878395
2026-01-28 20:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4e175b7d-c029-5052-919f-275f7d7751bd with identifier: 1878395 to the API
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/425/df204eeaf6104ed4abdacb60736a2f26/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4e175b7d-c029-5052-919f-275f7d7751bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 84528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e175b7d-c029-5052-919f-275f7d7751bd/4e175b7d-c029-5052-919f-275f7d7751bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/425/df204eeaf6104ed4abdacb60736a2f26/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Edition 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Edition 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878395%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [ayvens.es] INFO: Saving data for 1878395: {'created_time': 1769630503.242814, 'last_price_update_time': 1769630503.242829, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878395') HTTP/1.1" 204 0
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/270/f6a8226410684513b15655c55771d465/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:43 [ayvens.es] INFO: Found listing with ID: 1878408
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878408%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [ayvens.es] INFO: Scrape type for 1878408: 1
2026-01-28 20:01:43 [ayvens.es] INFO: Extracting data for car ID: 1878408
2026-01-28 20:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed1325f-6db4-5b4e-a703-1ac185c786dd with identifier: 1878408
2026-01-28 20:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed1325f-6db4-5b4e-a703-1ac185c786dd with scrape type 1
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ed1325f-6db4-5b4e-a703-1ac185c786dd
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F609%252F83033f7420484ae09e75c2d1cd902076%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/609/83033f7420484ae09e75c2d1cd902076/images/large/1.jpg not downloaded yet
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8582d0>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbcefc8-edcc-5f9d-b101-ba0134980872/1cbcefc8-edcc-5f9d-b101-ba0134980872_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252F1f37386c6e0b4a21a473ff311d9ec02f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/1f37386c6e0b4a21a473ff311d9ec02f/images/large/1.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cbcefc8-edcc-5f9d-b101-ba0134980872
2026-01-28 20:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cbcefc8-edcc-5f9d-b101-ba0134980872, skipping ID generation
2026-01-28 20:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cbcefc8-edcc-5f9d-b101-ba0134980872 with scrape type 1
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1cbcefc8-edcc-5f9d-b101-ba0134980872 from tracking dictionaries
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cbcefc8-edcc-5f9d-b101-ba0134980872 sending to next pipeline
2026-01-28 20:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1cbcefc8-edcc-5f9d-b101-ba0134980872, identifier: 1878397
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca88f310>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3760dbf-cb57-5878-91ca-91cdeff9d1c6/d3760dbf-cb57-5878-91ca-91cdeff9d1c6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F8c393ea42afb49ce8e16324f50ce29a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/8c393ea42afb49ce8e16324f50ce29a1/images/large/1.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3760dbf-cb57-5878-91ca-91cdeff9d1c6
2026-01-28 20:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3760dbf-cb57-5878-91ca-91cdeff9d1c6, skipping ID generation
2026-01-28 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3760dbf-cb57-5878-91ca-91cdeff9d1c6 with scrape type 1
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d3760dbf-cb57-5878-91ca-91cdeff9d1c6 from tracking dictionaries
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3760dbf-cb57-5878-91ca-91cdeff9d1c6 sending to next pipeline
2026-01-28 20:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3760dbf-cb57-5878-91ca-91cdeff9d1c6, identifier: 1878398
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca21f850>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714a45d2-9eba-53b7-be88-ae20e24ee54d/714a45d2-9eba-53b7-be88-ae20e24ee54d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Ff4942a7ad6974dfa940b506e62da8274%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/f4942a7ad6974dfa940b506e62da8274/images/large/1.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 714a45d2-9eba-53b7-be88-ae20e24ee54d
2026-01-28 20:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 714a45d2-9eba-53b7-be88-ae20e24ee54d, skipping ID generation
2026-01-28 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714a45d2-9eba-53b7-be88-ae20e24ee54d with scrape type 1
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 714a45d2-9eba-53b7-be88-ae20e24ee54d from tracking dictionaries
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 714a45d2-9eba-53b7-be88-ae20e24ee54d sending to next pipeline
2026-01-28 20:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 714a45d2-9eba-53b7-be88-ae20e24ee54d, identifier: 1878400
2026-01-28 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/161/9d36ceaa4c5b442bada4ccbe89c26d36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1cbcefc8-edcc-5f9d-b101-ba0134980872 with identifier: 1878397
2026-01-28 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1cbcefc8-edcc-5f9d-b101-ba0134980872 with identifier: 1878397
2026-01-28 20:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1cbcefc8-edcc-5f9d-b101-ba0134980872 with identifier: 1878397 to the API
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/047/1f37386c6e0b4a21a473ff311d9ec02f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1cbcefc8-edcc-5f9d-b101-ba0134980872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 57022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbcefc8-edcc-5f9d-b101-ba0134980872/1cbcefc8-edcc-5f9d-b101-ba0134980872_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/047/1f37386c6e0b4a21a473ff311d9ec02f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878397%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [ayvens.es] INFO: Saving data for 1878397: {'created_time': 1769630505.097381, 'last_price_update_time': 1769630505.097392, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878397') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3760dbf-cb57-5878-91ca-91cdeff9d1c6 with identifier: 1878398
2026-01-28 20:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3760dbf-cb57-5878-91ca-91cdeff9d1c6 with identifier: 1878398
2026-01-28 20:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3760dbf-cb57-5878-91ca-91cdeff9d1c6 with identifier: 1878398 to the API
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/260/8c393ea42afb49ce8e16324f50ce29a1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd3760dbf-cb57-5878-91ca-91cdeff9d1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 56726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3760dbf-cb57-5878-91ca-91cdeff9d1c6/d3760dbf-cb57-5878-91ca-91cdeff9d1c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/260/8c393ea42afb49ce8e16324f50ce29a1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 180 Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 180 Shooting Brake',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878398%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [ayvens.es] INFO: Saving data for 1878398: {'created_time': 1769630505.532429, 'last_price_update_time': 1769630505.532439, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878398') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 714a45d2-9eba-53b7-be88-ae20e24ee54d with identifier: 1878400
2026-01-28 20:01:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 714a45d2-9eba-53b7-be88-ae20e24ee54d with identifier: 1878400
2026-01-28 20:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 714a45d2-9eba-53b7-be88-ae20e24ee54d with identifier: 1878400 to the API
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/469/f4942a7ad6974dfa940b506e62da8274/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Dark',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '714a45d2-9eba-53b7-be88-ae20e24ee54d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 56969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714a45d2-9eba-53b7-be88-ae20e24ee54d/714a45d2-9eba-53b7-be88-ae20e24ee54d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/469/f4942a7ad6974dfa940b506e62da8274/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878400%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [ayvens.es] INFO: Saving data for 1878400: {'created_time': 1769630505.997056, 'last_price_update_time': 1769630505.997068, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878400') HTTP/1.1" 204 0
2026-01-28 20:01:46 [ayvens.es] INFO: Found listing with ID: 1878409
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878409%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [ayvens.es] INFO: Scrape type for 1878409: 1
2026-01-28 20:01:46 [ayvens.es] INFO: Extracting data for car ID: 1878409
2026-01-28 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328046f8-1c2a-5023-9bcb-4a2ee33df735 with identifier: 1878409
2026-01-28 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328046f8-1c2a-5023-9bcb-4a2ee33df735 with scrape type 1
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 328046f8-1c2a-5023-9bcb-4a2ee33df735
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F431%252F60d2cfa53180425eb31b64bf72db4231%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/431/60d2cfa53180425eb31b64bf72db4231/images/large/1.jpg not downloaded yet
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/636/9dd53da761c84b48a0ff7c0a518dae13/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca25d4d0>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f52cd851-0f38-5abc-8ad0-75c04ee267c7/f52cd851-0f38-5abc-8ad0-75c04ee267c7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F270%252Ff6a8226410684513b15655c55771d465%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/270/f6a8226410684513b15655c55771d465/images/large/1.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f52cd851-0f38-5abc-8ad0-75c04ee267c7
2026-01-28 20:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f52cd851-0f38-5abc-8ad0-75c04ee267c7, skipping ID generation
2026-01-28 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52cd851-0f38-5abc-8ad0-75c04ee267c7 with scrape type 1
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f52cd851-0f38-5abc-8ad0-75c04ee267c7 from tracking dictionaries
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f52cd851-0f38-5abc-8ad0-75c04ee267c7 sending to next pipeline
2026-01-28 20:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f52cd851-0f38-5abc-8ad0-75c04ee267c7, identifier: 1878399
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:46 [ayvens.es] INFO: Found listing with ID: 1878410
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878410%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [ayvens.es] INFO: Scrape type for 1878410: 1
2026-01-28 20:01:46 [ayvens.es] INFO: Extracting data for car ID: 1878410
2026-01-28 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f07d8b57-d157-5d02-8833-1487facafab6 with identifier: 1878410
2026-01-28 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f07d8b57-d157-5d02-8833-1487facafab6 with scrape type 1
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f07d8b57-d157-5d02-8833-1487facafab6
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F356d8126cd4745b08fc5948db615f526%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/356d8126cd4745b08fc5948db615f526/images/large/1.jpg not downloaded yet
2026-01-28 20:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f52cd851-0f38-5abc-8ad0-75c04ee267c7 with identifier: 1878399
2026-01-28 20:01:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f52cd851-0f38-5abc-8ad0-75c04ee267c7 with identifier: 1878399
2026-01-28 20:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f52cd851-0f38-5abc-8ad0-75c04ee267c7 with identifier: 1878399 to the API
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/270/f6a8226410684513b15655c55771d465/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'P',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f52cd851-0f38-5abc-8ad0-75c04ee267c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 49308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f52cd851-0f38-5abc-8ad0-75c04ee267c7/f52cd851-0f38-5abc-8ad0-75c04ee267c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/270/f6a8226410684513b15655c55771d465/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18i',
 'transmission': 'manual',
 'trim': 'sDrive18i',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878399%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [ayvens.es] INFO: Saving data for 1878399: {'created_time': 1769630506.851309, 'last_price_update_time': 1769630506.851322, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878399') HTTP/1.1" 204 0
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca25fd10>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264f2aae-720d-59f8-8566-a58a7ba10bd5/264f2aae-720d-59f8-8566-a58a7ba10bd5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F9d36ceaa4c5b442bada4ccbe89c26d36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/9d36ceaa4c5b442bada4ccbe89c26d36/images/large/1.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 264f2aae-720d-59f8-8566-a58a7ba10bd5
2026-01-28 20:01:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 264f2aae-720d-59f8-8566-a58a7ba10bd5, skipping ID generation
2026-01-28 20:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264f2aae-720d-59f8-8566-a58a7ba10bd5 with scrape type 1
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 264f2aae-720d-59f8-8566-a58a7ba10bd5 from tracking dictionaries
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 264f2aae-720d-59f8-8566-a58a7ba10bd5 sending to next pipeline
2026-01-28 20:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 264f2aae-720d-59f8-8566-a58a7ba10bd5, identifier: 1878401
2026-01-28 20:01:47 [ayvens.es] INFO: Found listing with ID: 1878411
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878411%27 HTTP/1.1" 200 None
2026-01-28 20:01:47 [ayvens.es] INFO: Scrape type for 1878411: 1
2026-01-28 20:01:47 [ayvens.es] INFO: Extracting data for car ID: 1878411
2026-01-28 20:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92b73d59-05e8-5eb4-86f4-76182fde986e with identifier: 1878411
2026-01-28 20:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92b73d59-05e8-5eb4-86f4-76182fde986e with scrape type 1
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92b73d59-05e8-5eb4-86f4-76182fde986e
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F070%252Ff31bf0b963e14c6a86feeaf92fc1b2bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/070/f31bf0b963e14c6a86feeaf92fc1b2bb/images/large/1.jpg not downloaded yet
2026-01-28 20:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 264f2aae-720d-59f8-8566-a58a7ba10bd5 with identifier: 1878401
2026-01-28 20:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 264f2aae-720d-59f8-8566-a58a7ba10bd5 with identifier: 1878401
2026-01-28 20:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 264f2aae-720d-59f8-8566-a58a7ba10bd5 with identifier: 1878401 to the API
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/161/9d36ceaa4c5b442bada4ccbe89c26d36/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '264f2aae-720d-59f8-8566-a58a7ba10bd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 57870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264f2aae-720d-59f8-8566-a58a7ba10bd5/264f2aae-720d-59f8-8566-a58a7ba10bd5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/161/9d36ceaa4c5b442bada4ccbe89c26d36/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878401%27 HTTP/1.1" 200 None
2026-01-28 20:01:47 [ayvens.es] INFO: Saving data for 1878401: {'created_time': 1769630507.774271, 'last_price_update_time': 1769630507.774283, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878401') HTTP/1.1" 204 0
2026-01-28 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/498/86365062cb614fd1bfd193c6da789bfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/b5f30623cec04bc09de1e5ba575b1d6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca25d6d0>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da4c2874-4f0d-50e4-b01e-3cc4fb605a0a/da4c2874-4f0d-50e4-b01e-3cc4fb605a0a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252F9dd53da761c84b48a0ff7c0a518dae13%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/9dd53da761c84b48a0ff7c0a518dae13/images/large/1.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da4c2874-4f0d-50e4-b01e-3cc4fb605a0a
2026-01-28 20:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da4c2874-4f0d-50e4-b01e-3cc4fb605a0a, skipping ID generation
2026-01-28 20:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da4c2874-4f0d-50e4-b01e-3cc4fb605a0a with scrape type 1
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item da4c2874-4f0d-50e4-b01e-3cc4fb605a0a from tracking dictionaries
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da4c2874-4f0d-50e4-b01e-3cc4fb605a0a sending to next pipeline
2026-01-28 20:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da4c2874-4f0d-50e4-b01e-3cc4fb605a0a, identifier: 1878402
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1f7150>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70bffde6-f1dd-5341-b8ef-88529a892d50/70bffde6-f1dd-5341-b8ef-88529a892d50_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F373%252F820b15bb488b456e93f5a542e829a92b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70bffde6-f1dd-5341-b8ef-88529a892d50
2026-01-28 20:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70bffde6-f1dd-5341-b8ef-88529a892d50, skipping ID generation
2026-01-28 20:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70bffde6-f1dd-5341-b8ef-88529a892d50 with scrape type 1
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70bffde6-f1dd-5341-b8ef-88529a892d50 from tracking dictionaries
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70bffde6-f1dd-5341-b8ef-88529a892d50 sending to next pipeline
2026-01-28 20:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70bffde6-f1dd-5341-b8ef-88529a892d50, identifier: 1878404
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca2a9a10>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24/a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F097%252F555f5d14f0d741df9f812f0c70f67b9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24
2026-01-28 20:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24, skipping ID generation
2026-01-28 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 with scrape type 1
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 from tracking dictionaries
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 sending to next pipeline
2026-01-28 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24, identifier: 1878403
2026-01-28 20:01:49 [ayvens.es] INFO: Found listing with ID: 1878412
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878412%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [ayvens.es] INFO: Scrape type for 1878412: 1
2026-01-28 20:01:49 [ayvens.es] INFO: Extracting data for car ID: 1878412
2026-01-28 20:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e465a04d-031c-5806-b9ea-93d275a0404d with identifier: 1878412
2026-01-28 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e465a04d-031c-5806-b9ea-93d275a0404d with scrape type 1
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e465a04d-031c-5806-b9ea-93d275a0404d
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F403%252Fff1626b17bf34d93b89aa5a598d6b1ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/403/ff1626b17bf34d93b89aa5a598d6b1ab/images/large/1.jpg not downloaded yet
2026-01-28 20:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da4c2874-4f0d-50e4-b01e-3cc4fb605a0a with identifier: 1878402
2026-01-28 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da4c2874-4f0d-50e4-b01e-3cc4fb605a0a with identifier: 1878402
2026-01-28 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: da4c2874-4f0d-50e4-b01e-3cc4fb605a0a spider: ayvens.es
2026-01-28 20:01:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: da4c2874-4f0d-50e4-b01e-3cc4fb605a0a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da4c2874-4f0d-50e4-b01e-3cc4fb605a0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 150786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4c2874-4f0d-50e4-b01e-3cc4fb605a0a/da4c2874-4f0d-50e4-b01e-3cc4fb605a0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/636/9dd53da761c84b48a0ff7c0a518dae13/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 55kW CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 55kW CONTROL',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878402%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [ayvens.es] INFO: Saving data for 1878402: {'created_time': 1769630509.582225, 'last_price_update_time': 1769630509.58224, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878402') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70bffde6-f1dd-5341-b8ef-88529a892d50 with identifier: 1878404
2026-01-28 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70bffde6-f1dd-5341-b8ef-88529a892d50 with identifier: 1878404
2026-01-28 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': '2.0 tdi 85kw s&s style go', 'title': 'seat leon 2.0 tdi 85kw s&s style go', 'price': 0, 'odometer': 217945, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-22', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 113, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '70bffde6-f1dd-5341-b8ef-88529a892d50', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70bffde6-f1dd-5341-b8ef-88529a892d50/70bffde6-f1dd-5341-b8ef-88529a892d50_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338812}], 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 217945}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '70bffde6-f1dd-5341-b8ef-88529a892d50',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 217945,
     'odometer_in_km': 217945,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70bffde6-f1dd-5341-b8ef-88529a892d50/70bffde6-f1dd-5341-b8ef-88529a892d50_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 338812,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-04-22',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon 2.0 tdi 85kw s&s style go',
     'transmission': 'manual',
     'trim': '2.0 tdi 85kw s&s style go',
     'vin': None,
     'year': 2021}
2026-01-28 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 70bffde6-f1dd-5341-b8ef-88529a892d50 spider: ayvens.es
2026-01-28 20:01:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 70bffde6-f1dd-5341-b8ef-88529a892d50 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': '2.0 tdi 85kw s&s style go', 'title': 'seat leon 2.0 tdi 85kw s&s style go', 'price': 0, 'odometer': 217945, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-22', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 113, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '70bffde6-f1dd-5341-b8ef-88529a892d50', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70bffde6-f1dd-5341-b8ef-88529a892d50/70bffde6-f1dd-5341-b8ef-88529a892d50_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338812}], 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 217945}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '70bffde6-f1dd-5341-b8ef-88529a892d50',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 217945,
     'odometer_in_km': 217945,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70bffde6-f1dd-5341-b8ef-88529a892d50/70bffde6-f1dd-5341-b8ef-88529a892d50_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 338812,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-04-22',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon 2.0 tdi 85kw s&s style go',
     'transmission': 'manual',
     'trim': '2.0 tdi 85kw s&s style go',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '70bffde6-f1dd-5341-b8ef-88529a892d50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 217945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70bffde6-f1dd-5341-b8ef-88529a892d50/70bffde6-f1dd-5341-b8ef-88529a892d50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/373/820b15bb488b456e93f5a542e829a92b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878404%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [ayvens.es] INFO: Saving data for 1878404: {'created_time': 1769630509.905346, 'last_price_update_time': 1769630509.905357, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878404') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 with identifier: 1878403
2026-01-28 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 with identifier: 1878403
2026-01-28 20:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': '2.0 tdi 85kw s&s style go', 'title': 'seat leon 2.0 tdi 85kw s&s style go', 'price': 0, 'odometer': 222472, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-30', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 113, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24/a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 332014}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 222472}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 222472,
     'odometer_in_km': 222472,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24/a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 332014,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-30',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon 2.0 tdi 85kw s&s style go',
     'transmission': 'manual',
     'trim': '2.0 tdi 85kw s&s style go',
     'vin': None,
     'year': 2021}
2026-01-28 20:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 spider: ayvens.es
2026-01-28 20:01:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': '2.0 tdi 85kw s&s style go', 'title': 'seat leon 2.0 tdi 85kw s&s style go', 'price': 0, 'odometer': 222472, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-30', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 113, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24/a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 332014}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 222472}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 222472,
     'odometer_in_km': 222472,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24/a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 332014,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-30',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon 2.0 tdi 85kw s&s style go',
     'transmission': 'manual',
     'trim': '2.0 tdi 85kw s&s style go',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 222472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24/a468f64b-7cc5-5cb1-a7a0-9f7bb510bd24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/097/555f5d14f0d741df9f812f0c70f67b9c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878403%27 HTTP/1.1" 200 None
2026-01-28 20:01:50 [ayvens.es] INFO: Saving data for 1878403: {'created_time': 1769630510.153432, 'last_price_update_time': 1769630510.153443, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878403') HTTP/1.1" 204 0
2026-01-28 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/662/80aef0cf5b6a4b7cbbeabfd30523fa00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:50 [ayvens.es] INFO: Found listing with ID: 1878413
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878413%27 HTTP/1.1" 200 None
2026-01-28 20:01:50 [ayvens.es] INFO: Scrape type for 1878413: 1
2026-01-28 20:01:50 [ayvens.es] INFO: Extracting data for car ID: 1878413
2026-01-28 20:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 with identifier: 1878413
2026-01-28 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 with scrape type 1
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ac69a9b-70bd-509b-9a7e-c714ae7e1791
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F293c0114c5da4e30ac953852cad61f56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/293c0114c5da4e30ac953852cad61f56/images/large/1.jpg not downloaded yet
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8a8290>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404dd200-33eb-52cc-adda-01728d3b2175/404dd200-33eb-52cc-adda-01728d3b2175_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F498%252F86365062cb614fd1bfd193c6da789bfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/498/86365062cb614fd1bfd193c6da789bfe/images/large/1.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 404dd200-33eb-52cc-adda-01728d3b2175
2026-01-28 20:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 404dd200-33eb-52cc-adda-01728d3b2175, skipping ID generation
2026-01-28 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404dd200-33eb-52cc-adda-01728d3b2175 with scrape type 1
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 404dd200-33eb-52cc-adda-01728d3b2175 from tracking dictionaries
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 404dd200-33eb-52cc-adda-01728d3b2175 sending to next pipeline
2026-01-28 20:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 404dd200-33eb-52cc-adda-01728d3b2175, identifier: 1878405
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca91ef90>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acf7f32-18b1-5891-a3e2-31c87acfaf16/3acf7f32-18b1-5891-a3e2-31c87acfaf16_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252Fb5f30623cec04bc09de1e5ba575b1d6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/b5f30623cec04bc09de1e5ba575b1d6d/images/large/1.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3acf7f32-18b1-5891-a3e2-31c87acfaf16
2026-01-28 20:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3acf7f32-18b1-5891-a3e2-31c87acfaf16, skipping ID generation
2026-01-28 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3acf7f32-18b1-5891-a3e2-31c87acfaf16 with scrape type 1
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3acf7f32-18b1-5891-a3e2-31c87acfaf16 from tracking dictionaries
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3acf7f32-18b1-5891-a3e2-31c87acfaf16 sending to next pipeline
2026-01-28 20:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3acf7f32-18b1-5891-a3e2-31c87acfaf16, identifier: 1878406
2026-01-28 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/609/83033f7420484ae09e75c2d1cd902076/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:51 [ayvens.es] INFO: Found listing with ID: 1878414
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878414%27 HTTP/1.1" 200 None
2026-01-28 20:01:51 [ayvens.es] INFO: Scrape type for 1878414: 1
2026-01-28 20:01:51 [ayvens.es] INFO: Extracting data for car ID: 1878414
2026-01-28 20:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0107cc5c-5d66-5c75-af1d-37009183ea2d with identifier: 1878414
2026-01-28 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0107cc5c-5d66-5c75-af1d-37009183ea2d with scrape type 1
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0107cc5c-5d66-5c75-af1d-37009183ea2d
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F979%252Fe8b6abc6f7fc49519104c87ff046f37f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/979/e8b6abc6f7fc49519104c87ff046f37f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 404dd200-33eb-52cc-adda-01728d3b2175 with identifier: 1878405
2026-01-28 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 404dd200-33eb-52cc-adda-01728d3b2175 with identifier: 1878405
2026-01-28 20:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 404dd200-33eb-52cc-adda-01728d3b2175 with identifier: 1878405 to the API
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/498/86365062cb614fd1bfd193c6da789bfe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '404dd200-33eb-52cc-adda-01728d3b2175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 99075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404dd200-33eb-52cc-adda-01728d3b2175/404dd200-33eb-52cc-adda-01728d3b2175_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/498/86365062cb614fd1bfd193c6da789bfe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.0 TSI 85kW St&Sp Style Edit. Nav Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW St&Sp Style Edit. Nav Eco',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878405%27 HTTP/1.1" 200 None
2026-01-28 20:01:51 [ayvens.es] INFO: Saving data for 1878405: {'created_time': 1769630511.665232, 'last_price_update_time': 1769630511.665244, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878405') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3acf7f32-18b1-5891-a3e2-31c87acfaf16 with identifier: 1878406
2026-01-28 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3acf7f32-18b1-5891-a3e2-31c87acfaf16 with identifier: 1878406
2026-01-28 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
2026-01-28 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3acf7f32-18b1-5891-a3e2-31c87acfaf16 spider: ayvens.es
2026-01-28 20:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 3acf7f32-18b1-5891-a3e2-31c87acfaf16 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3acf7f32-18b1-5891-a3e2-31c87acfaf16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 103784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acf7f32-18b1-5891-a3e2-31c87acfaf16/3acf7f32-18b1-5891-a3e2-31c87acfaf16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/b5f30623cec04bc09de1e5ba575b1d6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L3H3 3500 Bl dCi 100kW (135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L3H3 3500 Bl dCi 100kW (135CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878406%27 HTTP/1.1" 200 None
2026-01-28 20:01:51 [ayvens.es] INFO: Saving data for 1878406: {'created_time': 1769630511.924686, 'last_price_update_time': 1769630511.924703, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878406') HTTP/1.1" 204 0
2026-01-28 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/431/60d2cfa53180425eb31b64bf72db4231/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:51 [ayvens.es] INFO: Found listing with ID: 1878415
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878415%27 HTTP/1.1" 200 None
2026-01-28 20:01:51 [ayvens.es] INFO: Scrape type for 1878415: 1
2026-01-28 20:01:51 [ayvens.es] INFO: Extracting data for car ID: 1878415
2026-01-28 20:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0df91020-0595-588e-b96d-d1b8d82da66d with identifier: 1878415
2026-01-28 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0df91020-0595-588e-b96d-d1b8d82da66d with scrape type 1
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0df91020-0595-588e-b96d-d1b8d82da66d
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F627%252F1d1acc657f954c128b8ad3be5ba3e38f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/627/1d1acc657f954c128b8ad3be5ba3e38f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca65cf50>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70433497-f646-55dc-8efa-7b88fb5a574c/70433497-f646-55dc-8efa-7b88fb5a574c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F662%252F80aef0cf5b6a4b7cbbeabfd30523fa00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/662/80aef0cf5b6a4b7cbbeabfd30523fa00/images/large/1.jpg saved to cache
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70433497-f646-55dc-8efa-7b88fb5a574c
2026-01-28 20:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70433497-f646-55dc-8efa-7b88fb5a574c, skipping ID generation
2026-01-28 20:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70433497-f646-55dc-8efa-7b88fb5a574c with scrape type 1
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70433497-f646-55dc-8efa-7b88fb5a574c from tracking dictionaries
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70433497-f646-55dc-8efa-7b88fb5a574c sending to next pipeline
2026-01-28 20:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70433497-f646-55dc-8efa-7b88fb5a574c, identifier: 1878407
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8b6fd0>
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed1325f-6db4-5b4e-a703-1ac185c786dd/8ed1325f-6db4-5b4e-a703-1ac185c786dd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F609%252F83033f7420484ae09e75c2d1cd902076%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/609/83033f7420484ae09e75c2d1cd902076/images/large/1.jpg saved to cache
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ed1325f-6db4-5b4e-a703-1ac185c786dd
2026-01-28 20:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ed1325f-6db4-5b4e-a703-1ac185c786dd, skipping ID generation
2026-01-28 20:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed1325f-6db4-5b4e-a703-1ac185c786dd with scrape type 1
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ed1325f-6db4-5b4e-a703-1ac185c786dd from tracking dictionaries
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ed1325f-6db4-5b4e-a703-1ac185c786dd sending to next pipeline
2026-01-28 20:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ed1325f-6db4-5b4e-a703-1ac185c786dd, identifier: 1878408
2026-01-28 20:01:52 [ayvens.es] INFO: Found listing with ID: 1878416
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878416%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [ayvens.es] INFO: Scrape type for 1878416: 1
2026-01-28 20:01:52 [ayvens.es] INFO: Extracting data for car ID: 1878416
2026-01-28 20:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f with identifier: 1878416
2026-01-28 20:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f with scrape type 1
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252F457c5730b63c43f4ae7a7f353f00b2c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/457c5730b63c43f4ae7a7f353f00b2c0/images/large/1.jpg not downloaded yet
2026-01-28 20:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70433497-f646-55dc-8efa-7b88fb5a574c with identifier: 1878407
2026-01-28 20:01:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70433497-f646-55dc-8efa-7b88fb5a574c with identifier: 1878407
2026-01-28 20:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174567 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174567
2026-01-28 20:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 70433497-f646-55dc-8efa-7b88fb5a574c spider: ayvens.es
2026-01-28 20:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 70433497-f646-55dc-8efa-7b88fb5a574c due to rule: high_mileage_for_country.json, error: 174567 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174567
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Corporativo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '70433497-f646-55dc-8efa-7b88fb5a574c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 174567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70433497-f646-55dc-8efa-7b88fb5a574c/70433497-f646-55dc-8efa-7b88fb5a574c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/662/80aef0cf5b6a4b7cbbeabfd30523fa00/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE BlueHDi 73kW (100CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE BlueHDi 73kW (100CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878407%27 HTTP/1.1" 200 None
2026-01-28 20:01:53 [ayvens.es] INFO: Saving data for 1878407: {'created_time': 1769630513.217974, 'last_price_update_time': 1769630513.217989, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878407') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ed1325f-6db4-5b4e-a703-1ac185c786dd with identifier: 1878408
2026-01-28 20:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ed1325f-6db4-5b4e-a703-1ac185c786dd with identifier: 1878408
2026-01-28 20:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ed1325f-6db4-5b4e-a703-1ac185c786dd with identifier: 1878408 to the API
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/609/83033f7420484ae09e75c2d1cd902076/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8ed1325f-6db4-5b4e-a703-1ac185c786dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 59115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed1325f-6db4-5b4e-a703-1ac185c786dd/8ed1325f-6db4-5b4e-a703-1ac185c786dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/609/83033f7420484ae09e75c2d1cd902076/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878408%27 HTTP/1.1" 200 None
2026-01-28 20:01:53 [ayvens.es] INFO: Saving data for 1878408: {'created_time': 1769630513.591843, 'last_price_update_time': 1769630513.591855, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878408') HTTP/1.1" 204 0
2026-01-28 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/070/f31bf0b963e14c6a86feeaf92fc1b2bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:53 [ayvens.es] INFO: Found listing with ID: 1878417
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878417%27 HTTP/1.1" 200 None
2026-01-28 20:01:53 [ayvens.es] INFO: Scrape type for 1878417: 1
2026-01-28 20:01:53 [ayvens.es] INFO: Extracting data for car ID: 1878417
2026-01-28 20:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abca7956-ae67-5a9b-9984-a37a31fdb2db with identifier: 1878417
2026-01-28 20:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abca7956-ae67-5a9b-9984-a37a31fdb2db with scrape type 1
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item abca7956-ae67-5a9b-9984-a37a31fdb2db
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252F316abc757647401fad00070b689d901f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca2549d0>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328046f8-1c2a-5023-9bcb-4a2ee33df735/328046f8-1c2a-5023-9bcb-4a2ee33df735_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F431%252F60d2cfa53180425eb31b64bf72db4231%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/431/60d2cfa53180425eb31b64bf72db4231/images/large/1.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 328046f8-1c2a-5023-9bcb-4a2ee33df735
2026-01-28 20:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 328046f8-1c2a-5023-9bcb-4a2ee33df735, skipping ID generation
2026-01-28 20:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328046f8-1c2a-5023-9bcb-4a2ee33df735 with scrape type 1
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 328046f8-1c2a-5023-9bcb-4a2ee33df735 from tracking dictionaries
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 328046f8-1c2a-5023-9bcb-4a2ee33df735 sending to next pipeline
2026-01-28 20:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 328046f8-1c2a-5023-9bcb-4a2ee33df735, identifier: 1878409
2026-01-28 20:01:54 [ayvens.es] INFO: Found listing with ID: 1878418
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878418%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [ayvens.es] INFO: Scrape type for 1878418: 1
2026-01-28 20:01:54 [ayvens.es] INFO: Extracting data for car ID: 1878418
2026-01-28 20:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 213d0114-b5ce-50b8-93c2-a2073b824968 with identifier: 1878418
2026-01-28 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 213d0114-b5ce-50b8-93c2-a2073b824968 with scrape type 1
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 213d0114-b5ce-50b8-93c2-a2073b824968
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252Fbbfa4962be0d41a2b6c53b4c06ec1aa1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/bbfa4962be0d41a2b6c53b4c06ec1aa1/images/large/1.jpg not downloaded yet
2026-01-28 20:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 328046f8-1c2a-5023-9bcb-4a2ee33df735 with identifier: 1878409
2026-01-28 20:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 328046f8-1c2a-5023-9bcb-4a2ee33df735 with identifier: 1878409
2026-01-28 20:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 328046f8-1c2a-5023-9bcb-4a2ee33df735 with identifier: 1878409 to the API
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/431/60d2cfa53180425eb31b64bf72db4231/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '328046f8-1c2a-5023-9bcb-4a2ee33df735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 80150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328046f8-1c2a-5023-9bcb-4a2ee33df735/328046f8-1c2a-5023-9bcb-4a2ee33df735_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/431/60d2cfa53180425eb31b64bf72db4231/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 Advanced 30 TDI 85kW (116CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 30 TDI 85kW (116CV) S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878409%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [ayvens.es] INFO: Saving data for 1878409: {'created_time': 1769630514.490209, 'last_price_update_time': 1769630514.490221, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878409') HTTP/1.1" 204 0
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/403/ff1626b17bf34d93b89aa5a598d6b1ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [ayvens.es] INFO: Found listing with ID: 1878419
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878419%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [ayvens.es] INFO: Scrape type for 1878419: 1
2026-01-28 20:01:54 [ayvens.es] INFO: Extracting data for car ID: 1878419
2026-01-28 20:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c82a3e9-7aa9-548e-ae06-b72ae7051935 with identifier: 1878419
2026-01-28 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c82a3e9-7aa9-548e-ae06-b72ae7051935 with scrape type 1
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8c82a3e9-7aa9-548e-ae06-b72ae7051935
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F7ac9c3df99364355b2b49786db877935%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/7ac9c3df99364355b2b49786db877935/images/large/1.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/161/356d8126cd4745b08fc5948db615f526/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/293c0114c5da4e30ac953852cad61f56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fcfe90>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b73d59-05e8-5eb4-86f4-76182fde986e/92b73d59-05e8-5eb4-86f4-76182fde986e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F070%252Ff31bf0b963e14c6a86feeaf92fc1b2bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/070/f31bf0b963e14c6a86feeaf92fc1b2bb/images/large/1.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92b73d59-05e8-5eb4-86f4-76182fde986e
2026-01-28 20:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92b73d59-05e8-5eb4-86f4-76182fde986e, skipping ID generation
2026-01-28 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92b73d59-05e8-5eb4-86f4-76182fde986e with scrape type 1
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 92b73d59-05e8-5eb4-86f4-76182fde986e from tracking dictionaries
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92b73d59-05e8-5eb4-86f4-76182fde986e sending to next pipeline
2026-01-28 20:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 92b73d59-05e8-5eb4-86f4-76182fde986e, identifier: 1878411
2026-01-28 20:01:54 [ayvens.es] INFO: Found listing with ID: 1878420
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878420%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [ayvens.es] INFO: Scrape type for 1878420: 1
2026-01-28 20:01:54 [ayvens.es] INFO: Extracting data for car ID: 1878420
2026-01-28 20:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 886d5e7b-cdb6-533d-917a-97ff7a2ad923 with identifier: 1878420
2026-01-28 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886d5e7b-cdb6-533d-917a-97ff7a2ad923 with scrape type 1
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 886d5e7b-cdb6-533d-917a-97ff7a2ad923
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252Fc1fbbe4c9ca9493a9729f1736ea540a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/c1fbbe4c9ca9493a9729f1736ea540a9/images/large/1.jpg not downloaded yet
2026-01-28 20:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 92b73d59-05e8-5eb4-86f4-76182fde986e with identifier: 1878411
2026-01-28 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 92b73d59-05e8-5eb4-86f4-76182fde986e with identifier: 1878411
2026-01-28 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193547 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193547
2026-01-28 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 92b73d59-05e8-5eb4-86f4-76182fde986e spider: ayvens.es
2026-01-28 20:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 92b73d59-05e8-5eb4-86f4-76182fde986e due to rule: high_mileage_for_country.json, error: 193547 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193547
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '92b73d59-05e8-5eb4-86f4-76182fde986e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 193547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b73d59-05e8-5eb4-86f4-76182fde986e/92b73d59-05e8-5eb4-86f4-76182fde986e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/070/f31bf0b963e14c6a86feeaf92fc1b2bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878411%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [ayvens.es] INFO: Saving data for 1878411: {'created_time': 1769630515.277793, 'last_price_update_time': 1769630515.277806, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878411') HTTP/1.1" 204 0
2026-01-28 20:01:55 [ayvens.es] INFO: Found listing with ID: 1878421
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878421%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [ayvens.es] INFO: Scrape type for 1878421: 1
2026-01-28 20:01:55 [ayvens.es] INFO: Extracting data for car ID: 1878421
2026-01-28 20:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba561bc0-d54a-5a2c-98ff-194c7286d4d4 with identifier: 1878421
2026-01-28 20:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba561bc0-d54a-5a2c-98ff-194c7286d4d4 with scrape type 1
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba561bc0-d54a-5a2c-98ff-194c7286d4d4
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F098%252F2b153dd0c23547d59c027ed55c788757%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/098/2b153dd0c23547d59c027ed55c788757/images/large/1.jpg not downloaded yet
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9141c90>
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e465a04d-031c-5806-b9ea-93d275a0404d/e465a04d-031c-5806-b9ea-93d275a0404d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F403%252Fff1626b17bf34d93b89aa5a598d6b1ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/403/ff1626b17bf34d93b89aa5a598d6b1ab/images/large/1.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e465a04d-031c-5806-b9ea-93d275a0404d
2026-01-28 20:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e465a04d-031c-5806-b9ea-93d275a0404d, skipping ID generation
2026-01-28 20:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e465a04d-031c-5806-b9ea-93d275a0404d with scrape type 1
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e465a04d-031c-5806-b9ea-93d275a0404d from tracking dictionaries
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e465a04d-031c-5806-b9ea-93d275a0404d sending to next pipeline
2026-01-28 20:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e465a04d-031c-5806-b9ea-93d275a0404d, identifier: 1878412
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca21b410>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07d8b57-d157-5d02-8833-1487facafab6/f07d8b57-d157-5d02-8833-1487facafab6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F356d8126cd4745b08fc5948db615f526%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/356d8126cd4745b08fc5948db615f526/images/large/1.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f07d8b57-d157-5d02-8833-1487facafab6
2026-01-28 20:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f07d8b57-d157-5d02-8833-1487facafab6, skipping ID generation
2026-01-28 20:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f07d8b57-d157-5d02-8833-1487facafab6 with scrape type 1
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f07d8b57-d157-5d02-8833-1487facafab6 from tracking dictionaries
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f07d8b57-d157-5d02-8833-1487facafab6 sending to next pipeline
2026-01-28 20:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f07d8b57-d157-5d02-8833-1487facafab6, identifier: 1878410
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca298050>
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ac69a9b-70bd-509b-9a7e-c714ae7e1791/8ac69a9b-70bd-509b-9a7e-c714ae7e1791_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F293c0114c5da4e30ac953852cad61f56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/293c0114c5da4e30ac953852cad61f56/images/large/1.jpg saved to cache
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ac69a9b-70bd-509b-9a7e-c714ae7e1791
2026-01-28 20:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ac69a9b-70bd-509b-9a7e-c714ae7e1791, skipping ID generation
2026-01-28 20:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 with scrape type 1
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 from tracking dictionaries
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 sending to next pipeline
2026-01-28 20:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ac69a9b-70bd-509b-9a7e-c714ae7e1791, identifier: 1878413
2026-01-28 20:01:57 [ayvens.es] INFO: Found listing with ID: 1878422
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878422%27 HTTP/1.1" 200 None
2026-01-28 20:01:57 [ayvens.es] INFO: Scrape type for 1878422: 1
2026-01-28 20:01:57 [ayvens.es] INFO: Extracting data for car ID: 1878422
2026-01-28 20:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 with identifier: 1878422
2026-01-28 20:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 with scrape type 1
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F982%252Ff2909d10e9f747d48e2e0c674cf2e07c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/982/f2909d10e9f747d48e2e0c674cf2e07c/images/large/1.jpg not downloaded yet
2026-01-28 20:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e465a04d-031c-5806-b9ea-93d275a0404d with identifier: 1878412
2026-01-28 20:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e465a04d-031c-5806-b9ea-93d275a0404d with identifier: 1878412
2026-01-28 20:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e465a04d-031c-5806-b9ea-93d275a0404d with identifier: 1878412 to the API
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/403/ff1626b17bf34d93b89aa5a598d6b1ab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e465a04d-031c-5806-b9ea-93d275a0404d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 120075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e465a04d-031c-5806-b9ea-93d275a0404d/e465a04d-031c-5806-b9ea-93d275a0404d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/403/ff1626b17bf34d93b89aa5a598d6b1ab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878412%27 HTTP/1.1" 200 None
2026-01-28 20:01:57 [ayvens.es] INFO: Saving data for 1878412: {'created_time': 1769630517.908886, 'last_price_update_time': 1769630517.908895, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878412') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f07d8b57-d157-5d02-8833-1487facafab6 with identifier: 1878410
2026-01-28 20:01:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f07d8b57-d157-5d02-8833-1487facafab6 with identifier: 1878410
2026-01-28 20:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f07d8b57-d157-5d02-8833-1487facafab6 with identifier: 1878410 to the API
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/161/356d8126cd4745b08fc5948db615f526/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f07d8b57-d157-5d02-8833-1487facafab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 52254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07d8b57-d157-5d02-8833-1487facafab6/f07d8b57-d157-5d02-8833-1487facafab6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/161/356d8126cd4745b08fc5948db615f526/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878410%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [ayvens.es] INFO: Saving data for 1878410: {'created_time': 1769630518.275906, 'last_price_update_time': 1769630518.275915, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878410') HTTP/1.1" 204 0
2026-01-28 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 with identifier: 1878413
2026-01-28 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 with identifier: 1878413
2026-01-28 20:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ac69a9b-70bd-509b-9a7e-c714ae7e1791 with identifier: 1878413 to the API
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/293c0114c5da4e30ac953852cad61f56/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ac69a9b-70bd-509b-9a7e-c714ae7e1791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 59409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac69a9b-70bd-509b-9a7e-c714ae7e1791/8ac69a9b-70bd-509b-9a7e-c714ae7e1791_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/293c0114c5da4e30ac953852cad61f56/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW Reference Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW Reference Eco',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878413%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [ayvens.es] INFO: Saving data for 1878413: {'created_time': 1769630518.665667, 'last_price_update_time': 1769630518.665682, 'auction_closing_time': 1769688000.0}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878413') HTTP/1.1" 204 0
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/979/e8b6abc6f7fc49519104c87ff046f37f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/627/1d1acc657f954c128b8ad3be5ba3e38f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/944/457c5730b63c43f4ae7a7f353f00b2c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [ayvens.es] INFO: Found listing with ID: 1878423
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878423%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [ayvens.es] INFO: Scrape type for 1878423: 1
2026-01-28 20:01:58 [ayvens.es] INFO: Extracting data for car ID: 1878423
2026-01-28 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dfb03d0-634a-5d70-815b-aa157fb31ab8 with identifier: 1878423
2026-01-28 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dfb03d0-634a-5d70-815b-aa157fb31ab8 with scrape type 1
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6dfb03d0-634a-5d70-815b-aa157fb31ab8
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252Fb932c631e9a14ae790b844fe772dfea1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/b932c631e9a14ae790b844fe772dfea1/images/large/1.jpg not downloaded yet
2026-01-28 20:01:58 [ayvens.es] INFO: Found listing with ID: 1878424
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878424%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [ayvens.es] INFO: Scrape type for 1878424: 1
2026-01-28 20:01:58 [ayvens.es] INFO: Extracting data for car ID: 1878424
2026-01-28 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59675bef-bc43-5fc1-9a3c-a716e9848d73 with identifier: 1878424
2026-01-28 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59675bef-bc43-5fc1-9a3c-a716e9848d73 with scrape type 1
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 59675bef-bc43-5fc1-9a3c-a716e9848d73
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F743%252F9d0f04ec660d4ed4ba0440e431a01ee3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/743/9d0f04ec660d4ed4ba0440e431a01ee3/images/large/1.jpg not downloaded yet
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/167/bbfa4962be0d41a2b6c53b4c06ec1aa1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [ayvens.es] INFO: Found listing with ID: 1878425
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878425%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [ayvens.es] INFO: Scrape type for 1878425: 1
2026-01-28 20:01:58 [ayvens.es] INFO: Extracting data for car ID: 1878425
2026-01-28 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c782c10-7902-5a1b-a697-f33d692958a9 with identifier: 1878425
2026-01-28 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c782c10-7902-5a1b-a697-f33d692958a9 with scrape type 1
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c782c10-7902-5a1b-a697-f33d692958a9
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F608%252F6778e669ed5b4b0ea5e748d87a50e306%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/608/6778e669ed5b4b0ea5e748d87a50e306/images/large/1.jpg not downloaded yet
2026-01-28 20:01:58 [ayvens.es] INFO: Found listing with ID: 1878426
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878426%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [ayvens.es] INFO: Scrape type for 1878426: 1
2026-01-28 20:01:58 [ayvens.es] INFO: Extracting data for car ID: 1878426
2026-01-28 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76586331-ab2c-5ea6-aadf-d33d77a0645f with identifier: 1878426
2026-01-28 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76586331-ab2c-5ea6-aadf-d33d77a0645f with scrape type 1
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76586331-ab2c-5ea6-aadf-d33d77a0645f
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252F43ccb02532bd4de7ae0b8bf6a3e939a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/43ccb02532bd4de7ae0b8bf6a3e939a7/images/large/1.jpg not downloaded yet
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91442d0>
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0107cc5c-5d66-5c75-af1d-37009183ea2d/0107cc5c-5d66-5c75-af1d-37009183ea2d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F979%252Fe8b6abc6f7fc49519104c87ff046f37f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/979/e8b6abc6f7fc49519104c87ff046f37f/images/large/1.jpg saved to cache
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0107cc5c-5d66-5c75-af1d-37009183ea2d
2026-01-28 20:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0107cc5c-5d66-5c75-af1d-37009183ea2d, skipping ID generation
2026-01-28 20:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0107cc5c-5d66-5c75-af1d-37009183ea2d with scrape type 1
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0107cc5c-5d66-5c75-af1d-37009183ea2d from tracking dictionaries
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0107cc5c-5d66-5c75-af1d-37009183ea2d sending to next pipeline
2026-01-28 20:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0107cc5c-5d66-5c75-af1d-37009183ea2d, identifier: 1878414
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca27d050>
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0df91020-0595-588e-b96d-d1b8d82da66d/0df91020-0595-588e-b96d-d1b8d82da66d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F627%252F1d1acc657f954c128b8ad3be5ba3e38f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/627/1d1acc657f954c128b8ad3be5ba3e38f/images/large/1.jpg saved to cache
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0df91020-0595-588e-b96d-d1b8d82da66d
2026-01-28 20:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0df91020-0595-588e-b96d-d1b8d82da66d, skipping ID generation
2026-01-28 20:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0df91020-0595-588e-b96d-d1b8d82da66d with scrape type 1
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0df91020-0595-588e-b96d-d1b8d82da66d from tracking dictionaries
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0df91020-0595-588e-b96d-d1b8d82da66d sending to next pipeline
2026-01-28 20:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0df91020-0595-588e-b96d-d1b8d82da66d, identifier: 1878415
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8b5910>
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f/0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252F457c5730b63c43f4ae7a7f353f00b2c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/457c5730b63c43f4ae7a7f353f00b2c0/images/large/1.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f
2026-01-28 20:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f, skipping ID generation
2026-01-28 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f with scrape type 1
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f from tracking dictionaries
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f sending to next pipeline
2026-01-28 20:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f, identifier: 1878416
2026-01-28 20:02:00 [ayvens.es] INFO: Found listing with ID: 1878427
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878427%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [ayvens.es] INFO: Scrape type for 1878427: 1
2026-01-28 20:02:00 [ayvens.es] INFO: Extracting data for car ID: 1878427
2026-01-28 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3135436e-10e9-5ea3-9ac0-22370fa679b5 with identifier: 1878427
2026-01-28 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3135436e-10e9-5ea3-9ac0-22370fa679b5 with scrape type 1
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3135436e-10e9-5ea3-9ac0-22370fa679b5
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F919%252Faf6aefde326644a5817f1e4048b38f5f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/919/af6aefde326644a5817f1e4048b38f5f/images/large/1.jpg not downloaded yet
2026-01-28 20:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0107cc5c-5d66-5c75-af1d-37009183ea2d with identifier: 1878414
2026-01-28 20:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0107cc5c-5d66-5c75-af1d-37009183ea2d with identifier: 1878414
2026-01-28 20:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
2026-01-28 20:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0107cc5c-5d66-5c75-af1d-37009183ea2d spider: ayvens.es
2026-01-28 20:02:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0107cc5c-5d66-5c75-af1d-37009183ea2d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0107cc5c-5d66-5c75-af1d-37009183ea2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 117921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0107cc5c-5d66-5c75-af1d-37009183ea2d/0107cc5c-5d66-5c75-af1d-37009183ea2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/979/e8b6abc6f7fc49519104c87ff046f37f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878414%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [ayvens.es] INFO: Saving data for 1878414: {'created_time': 1769630520.632271, 'last_price_update_time': 1769630520.632282, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878414') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0df91020-0595-588e-b96d-d1b8d82da66d with identifier: 1878415
2026-01-28 20:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0df91020-0595-588e-b96d-d1b8d82da66d with identifier: 1878415
2026-01-28 20:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0df91020-0595-588e-b96d-d1b8d82da66d with identifier: 1878415 to the API
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/627/1d1acc657f954c128b8ad3be5ba3e38f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0df91020-0595-588e-b96d-d1b8d82da66d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 48593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0df91020-0595-588e-b96d-d1b8d82da66d/0df91020-0595-588e-b96d-d1b8d82da66d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/627/1d1acc657f954c128b8ad3be5ba3e38f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance R-Line 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Advance R-Line 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878415%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [ayvens.es] INFO: Saving data for 1878415: {'created_time': 1769630521.00624, 'last_price_update_time': 1769630521.006251, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878415') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f with identifier: 1878416
2026-01-28 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f with identifier: 1878416
2026-01-28 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190519 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190519
2026-01-28 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f spider: ayvens.es
2026-01-28 20:02:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f due to rule: high_mileage_for_country.json, error: 190519 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190519
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.9L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE COUPE',
 'odometer': 190519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f/0f6723d5-9ada-5a5a-a2ce-ebc59efc6d9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/944/457c5730b63c43f4ae7a7f353f00b2c0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE COUPE GLE 350 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLE 350 d 4MATIC',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878416%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [ayvens.es] INFO: Saving data for 1878416: {'created_time': 1769630521.301229, 'last_price_update_time': 1769630521.301242, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878416') HTTP/1.1" 204 0
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/689/7ac9c3df99364355b2b49786db877935/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca65e850>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abca7956-ae67-5a9b-9984-a37a31fdb2db/abca7956-ae67-5a9b-9984-a37a31fdb2db_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252F316abc757647401fad00070b689d901f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg saved to cache
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abca7956-ae67-5a9b-9984-a37a31fdb2db
2026-01-28 20:02:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abca7956-ae67-5a9b-9984-a37a31fdb2db, skipping ID generation
2026-01-28 20:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abca7956-ae67-5a9b-9984-a37a31fdb2db with scrape type 1
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item abca7956-ae67-5a9b-9984-a37a31fdb2db from tracking dictionaries
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abca7956-ae67-5a9b-9984-a37a31fdb2db sending to next pipeline
2026-01-28 20:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: abca7956-ae67-5a9b-9984-a37a31fdb2db, identifier: 1878417
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c916be10>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213d0114-b5ce-50b8-93c2-a2073b824968/213d0114-b5ce-50b8-93c2-a2073b824968_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252Fbbfa4962be0d41a2b6c53b4c06ec1aa1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/bbfa4962be0d41a2b6c53b4c06ec1aa1/images/large/1.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 213d0114-b5ce-50b8-93c2-a2073b824968
2026-01-28 20:02:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 213d0114-b5ce-50b8-93c2-a2073b824968, skipping ID generation
2026-01-28 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 213d0114-b5ce-50b8-93c2-a2073b824968 with scrape type 1
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 213d0114-b5ce-50b8-93c2-a2073b824968 from tracking dictionaries
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 213d0114-b5ce-50b8-93c2-a2073b824968 sending to next pipeline
2026-01-28 20:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 213d0114-b5ce-50b8-93c2-a2073b824968, identifier: 1878418
2026-01-28 20:02:02 [ayvens.es] INFO: Found listing with ID: 1878428
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878428%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [ayvens.es] INFO: Scrape type for 1878428: 1
2026-01-28 20:02:02 [ayvens.es] INFO: Extracting data for car ID: 1878428
2026-01-28 20:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb3e2edd-236c-5371-b996-f60029bfd596 with identifier: 1878428
2026-01-28 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3e2edd-236c-5371-b996-f60029bfd596 with scrape type 1
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb3e2edd-236c-5371-b996-f60029bfd596
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F000%252Fe8d700282f82402b94106147986ca19a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/000/e8d700282f82402b94106147986ca19a/images/large/1.jpg not downloaded yet
2026-01-28 20:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: abca7956-ae67-5a9b-9984-a37a31fdb2db with identifier: 1878417
2026-01-28 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: abca7956-ae67-5a9b-9984-a37a31fdb2db with identifier: 1878417
2026-01-28 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': 'business line 1.2 puretech 81kw (110cv)', 'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)', 'price': 0, 'odometer': 167434, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-22', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 111, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'abca7956-ae67-5a9b-9984-a37a31fdb2db', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abca7956-ae67-5a9b-9984-a37a31fdb2db/abca7956-ae67-5a9b-9984-a37a31fdb2db_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 605628}], 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 167434}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 111,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'abca7956-ae67-5a9b-9984-a37a31fdb2db',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 167434,
     'odometer_in_km': 167434,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abca7956-ae67-5a9b-9984-a37a31fdb2db/abca7956-ae67-5a9b-9984-a37a31fdb2db_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 605628,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-02-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)',
     'transmission': 'manual',
     'trim': 'business line 1.2 puretech 81kw (110cv)',
     'vin': None,
     'year': 2019}
2026-01-28 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: abca7956-ae67-5a9b-9984-a37a31fdb2db spider: ayvens.es
2026-01-28 20:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: abca7956-ae67-5a9b-9984-a37a31fdb2db due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': 'business line 1.2 puretech 81kw (110cv)', 'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)', 'price': 0, 'odometer': 167434, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-22', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 111, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'abca7956-ae67-5a9b-9984-a37a31fdb2db', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abca7956-ae67-5a9b-9984-a37a31fdb2db/abca7956-ae67-5a9b-9984-a37a31fdb2db_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 605628}], 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 167434}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 111,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'abca7956-ae67-5a9b-9984-a37a31fdb2db',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 167434,
     'odometer_in_km': 167434,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abca7956-ae67-5a9b-9984-a37a31fdb2db/abca7956-ae67-5a9b-9984-a37a31fdb2db_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 605628,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-02-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)',
     'transmission': 'manual',
     'trim': 'business line 1.2 puretech 81kw (110cv)',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'abca7956-ae67-5a9b-9984-a37a31fdb2db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 167434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abca7956-ae67-5a9b-9984-a37a31fdb2db/abca7956-ae67-5a9b-9984-a37a31fdb2db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/316abc757647401fad00070b689d901f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 Business Line 1.2 PureTech 81KW (110CV)',
 'transmission': 'manual',
 'trim': 'Business Line 1.2 PureTech 81KW (110CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878417%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [ayvens.es] INFO: Saving data for 1878417: {'created_time': 1769630522.465129, 'last_price_update_time': 1769630522.46514, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878417') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 213d0114-b5ce-50b8-93c2-a2073b824968 with identifier: 1878418
2026-01-28 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 213d0114-b5ce-50b8-93c2-a2073b824968 with identifier: 1878418
2026-01-28 20:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 213d0114-b5ce-50b8-93c2-a2073b824968 with identifier: 1878418 to the API
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/167/bbfa4962be0d41a2b6c53b4c06ec1aa1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '213d0114-b5ce-50b8-93c2-a2073b824968',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 94561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213d0114-b5ce-50b8-93c2-a2073b824968/213d0114-b5ce-50b8-93c2-a2073b824968_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/167/bbfa4962be0d41a2b6c53b4c06ec1aa1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT Shooting Brake',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878418%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [ayvens.es] INFO: Saving data for 1878418: {'created_time': 1769630522.904944, 'last_price_update_time': 1769630522.904955, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878418') HTTP/1.1" 204 0
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/899/c1fbbe4c9ca9493a9729f1736ea540a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/758/b932c631e9a14ae790b844fe772dfea1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [ayvens.es] INFO: Found listing with ID: 1878429
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878429%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [ayvens.es] INFO: Scrape type for 1878429: 1
2026-01-28 20:02:02 [ayvens.es] INFO: Extracting data for car ID: 1878429
2026-01-28 20:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ff319e9-b9e2-5fe3-948c-277303e140f9 with identifier: 1878429
2026-01-28 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ff319e9-b9e2-5fe3-948c-277303e140f9 with scrape type 1
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ff319e9-b9e2-5fe3-948c-277303e140f9
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F745%252Fd67dbeb6394f4223a9662134ee682d70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/745/d67dbeb6394f4223a9662134ee682d70/images/large/1.jpg not downloaded yet
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca25e210>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c82a3e9-7aa9-548e-ae06-b72ae7051935/8c82a3e9-7aa9-548e-ae06-b72ae7051935_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F7ac9c3df99364355b2b49786db877935%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/7ac9c3df99364355b2b49786db877935/images/large/1.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c82a3e9-7aa9-548e-ae06-b72ae7051935
2026-01-28 20:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c82a3e9-7aa9-548e-ae06-b72ae7051935, skipping ID generation
2026-01-28 20:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c82a3e9-7aa9-548e-ae06-b72ae7051935 with scrape type 1
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8c82a3e9-7aa9-548e-ae06-b72ae7051935 from tracking dictionaries
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c82a3e9-7aa9-548e-ae06-b72ae7051935 sending to next pipeline
2026-01-28 20:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8c82a3e9-7aa9-548e-ae06-b72ae7051935, identifier: 1878419
2026-01-28 20:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8c82a3e9-7aa9-548e-ae06-b72ae7051935 with identifier: 1878419
2026-01-28 20:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8c82a3e9-7aa9-548e-ae06-b72ae7051935 with identifier: 1878419
2026-01-28 20:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8c82a3e9-7aa9-548e-ae06-b72ae7051935 with identifier: 1878419 to the API
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/689/7ac9c3df99364355b2b49786db877935/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c82a3e9-7aa9-548e-ae06-b72ae7051935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 81779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c82a3e9-7aa9-548e-ae06-b72ae7051935/8c82a3e9-7aa9-548e-ae06-b72ae7051935_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/689/7ac9c3df99364355b2b49786db877935/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878419%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [ayvens.es] INFO: Saving data for 1878419: {'created_time': 1769630523.783962, 'last_price_update_time': 1769630523.783974, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878419') HTTP/1.1" 204 0
2026-01-28 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/982/f2909d10e9f747d48e2e0c674cf2e07c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/743/9d0f04ec660d4ed4ba0440e431a01ee3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:03 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-01-28 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/098/2b153dd0c23547d59c027ed55c788757/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9152750>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886d5e7b-cdb6-533d-917a-97ff7a2ad923/886d5e7b-cdb6-533d-917a-97ff7a2ad923_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252Fc1fbbe4c9ca9493a9729f1736ea540a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/c1fbbe4c9ca9493a9729f1736ea540a9/images/large/1.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 886d5e7b-cdb6-533d-917a-97ff7a2ad923
2026-01-28 20:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 886d5e7b-cdb6-533d-917a-97ff7a2ad923, skipping ID generation
2026-01-28 20:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886d5e7b-cdb6-533d-917a-97ff7a2ad923 with scrape type 1
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 886d5e7b-cdb6-533d-917a-97ff7a2ad923 from tracking dictionaries
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 886d5e7b-cdb6-533d-917a-97ff7a2ad923 sending to next pipeline
2026-01-28 20:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 886d5e7b-cdb6-533d-917a-97ff7a2ad923, identifier: 1878420
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c916f650>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dfb03d0-634a-5d70-815b-aa157fb31ab8/6dfb03d0-634a-5d70-815b-aa157fb31ab8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252Fb932c631e9a14ae790b844fe772dfea1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/b932c631e9a14ae790b844fe772dfea1/images/large/1.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6dfb03d0-634a-5d70-815b-aa157fb31ab8
2026-01-28 20:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6dfb03d0-634a-5d70-815b-aa157fb31ab8, skipping ID generation
2026-01-28 20:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dfb03d0-634a-5d70-815b-aa157fb31ab8 with scrape type 1
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6dfb03d0-634a-5d70-815b-aa157fb31ab8 from tracking dictionaries
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6dfb03d0-634a-5d70-815b-aa157fb31ab8 sending to next pipeline
2026-01-28 20:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6dfb03d0-634a-5d70-815b-aa157fb31ab8, identifier: 1878423
2026-01-28 20:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 886d5e7b-cdb6-533d-917a-97ff7a2ad923 with identifier: 1878420
2026-01-28 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 886d5e7b-cdb6-533d-917a-97ff7a2ad923 with identifier: 1878420
2026-01-28 20:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 886d5e7b-cdb6-533d-917a-97ff7a2ad923 with identifier: 1878420 to the API
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/899/c1fbbe4c9ca9493a9729f1736ea540a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '886d5e7b-cdb6-533d-917a-97ff7a2ad923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 114444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886d5e7b-cdb6-533d-917a-97ff7a2ad923/886d5e7b-cdb6-533d-917a-97ff7a2ad923_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/899/c1fbbe4c9ca9493a9729f1736ea540a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878420%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [ayvens.es] INFO: Saving data for 1878420: {'created_time': 1769630524.935329, 'last_price_update_time': 1769630524.935342, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878420') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6dfb03d0-634a-5d70-815b-aa157fb31ab8 with identifier: 1878423
2026-01-28 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6dfb03d0-634a-5d70-815b-aa157fb31ab8 with identifier: 1878423
2026-01-28 20:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6dfb03d0-634a-5d70-815b-aa157fb31ab8 with identifier: 1878423 to the API
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/758/b932c631e9a14ae790b844fe772dfea1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Clear',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6dfb03d0-634a-5d70-815b-aa157fb31ab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 65710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dfb03d0-634a-5d70-815b-aa157fb31ab8/6dfb03d0-634a-5d70-815b-aa157fb31ab8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/758/b932c631e9a14ae790b844fe772dfea1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'vin': None,
 'year': 2022}
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878423%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [ayvens.es] INFO: Saving data for 1878423: {'created_time': 1769630525.350123, 'last_price_update_time': 1769630525.350135, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878423') HTTP/1.1" 204 0
2026-01-28 20:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/608/6778e669ed5b4b0ea5e748d87a50e306/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/919/af6aefde326644a5817f1e4048b38f5f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca2655d0>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8999ab61-6eb1-59b4-9f8c-f6b2cffd6449/8999ab61-6eb1-59b4-9f8c-f6b2cffd6449_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F982%252Ff2909d10e9f747d48e2e0c674cf2e07c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/982/f2909d10e9f747d48e2e0c674cf2e07c/images/large/1.jpg saved to cache
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449
2026-01-28 20:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449, skipping ID generation
2026-01-28 20:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 with scrape type 1
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 from tracking dictionaries
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 sending to next pipeline
2026-01-28 20:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449, identifier: 1878422
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca24c110>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59675bef-bc43-5fc1-9a3c-a716e9848d73/59675bef-bc43-5fc1-9a3c-a716e9848d73_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F743%252F9d0f04ec660d4ed4ba0440e431a01ee3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/743/9d0f04ec660d4ed4ba0440e431a01ee3/images/large/1.jpg saved to cache
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59675bef-bc43-5fc1-9a3c-a716e9848d73
2026-01-28 20:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59675bef-bc43-5fc1-9a3c-a716e9848d73, skipping ID generation
2026-01-28 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59675bef-bc43-5fc1-9a3c-a716e9848d73 with scrape type 1
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 59675bef-bc43-5fc1-9a3c-a716e9848d73 from tracking dictionaries
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59675bef-bc43-5fc1-9a3c-a716e9848d73 sending to next pipeline
2026-01-28 20:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 59675bef-bc43-5fc1-9a3c-a716e9848d73, identifier: 1878424
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91b0f10>
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba561bc0-d54a-5a2c-98ff-194c7286d4d4/ba561bc0-d54a-5a2c-98ff-194c7286d4d4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F098%252F2b153dd0c23547d59c027ed55c788757%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/098/2b153dd0c23547d59c027ed55c788757/images/large/1.jpg saved to cache
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba561bc0-d54a-5a2c-98ff-194c7286d4d4
2026-01-28 20:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba561bc0-d54a-5a2c-98ff-194c7286d4d4, skipping ID generation
2026-01-28 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba561bc0-d54a-5a2c-98ff-194c7286d4d4 with scrape type 1
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ba561bc0-d54a-5a2c-98ff-194c7286d4d4 from tracking dictionaries
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba561bc0-d54a-5a2c-98ff-194c7286d4d4 sending to next pipeline
2026-01-28 20:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ba561bc0-d54a-5a2c-98ff-194c7286d4d4, identifier: 1878421
2026-01-28 20:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 with identifier: 1878422
2026-01-28 20:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 with identifier: 1878422
2026-01-28 20:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186085 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186085
2026-01-28 20:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 spider: ayvens.es
2026-01-28 20:02:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8999ab61-6eb1-59b4-9f8c-f6b2cffd6449 due to rule: high_mileage_for_country.json, error: 186085 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186085
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8999ab61-6eb1-59b4-9f8c-f6b2cffd6449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 186085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8999ab61-6eb1-59b4-9f8c-f6b2cffd6449/8999ab61-6eb1-59b4-9f8c-f6b2cffd6449_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/982/f2909d10e9f747d48e2e0c674cf2e07c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) DSG Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) DSG Ambition',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878422%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [ayvens.es] INFO: Saving data for 1878422: {'created_time': 1769630526.718397, 'last_price_update_time': 1769630526.718409, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878422') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 59675bef-bc43-5fc1-9a3c-a716e9848d73 with identifier: 1878424
2026-01-28 20:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 59675bef-bc43-5fc1-9a3c-a716e9848d73 with identifier: 1878424
2026-01-28 20:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 59675bef-bc43-5fc1-9a3c-a716e9848d73 with identifier: 1878424 to the API
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/743/9d0f04ec660d4ed4ba0440e431a01ee3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '59675bef-bc43-5fc1-9a3c-a716e9848d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 75348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59675bef-bc43-5fc1-9a3c-a716e9848d73/59675bef-bc43-5fc1-9a3c-a716e9848d73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/743/9d0f04ec660d4ed4ba0440e431a01ee3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878424%27 HTTP/1.1" 200 None
2026-01-28 20:02:07 [ayvens.es] INFO: Saving data for 1878424: {'created_time': 1769630527.141857, 'last_price_update_time': 1769630527.141869, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878424') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ba561bc0-d54a-5a2c-98ff-194c7286d4d4 with identifier: 1878421
2026-01-28 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ba561bc0-d54a-5a2c-98ff-194c7286d4d4 with identifier: 1878421
2026-01-28 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-28 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ba561bc0-d54a-5a2c-98ff-194c7286d4d4 spider: ayvens.es
2026-01-28 20:02:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ba561bc0-d54a-5a2c-98ff-194c7286d4d4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ba561bc0-d54a-5a2c-98ff-194c7286d4d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'PANDA',
 'odometer': 79534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba561bc0-d54a-5a2c-98ff-194c7286d4d4/ba561bc0-d54a-5a2c-98ff-194c7286d4d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/098/2b153dd0c23547d59c027ed55c788757/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT PANDA 1.2 Lounge 51kW (69CV)',
 'transmission': 'manual',
 'trim': '1.2 Lounge 51kW (69CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878421%27 HTTP/1.1" 200 None
2026-01-28 20:02:07 [ayvens.es] INFO: Saving data for 1878421: {'created_time': 1769630527.405037, 'last_price_update_time': 1769630527.405046, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878421') HTTP/1.1" 204 0
2026-01-28 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/012/43ccb02532bd4de7ae0b8bf6a3e939a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/000/e8d700282f82402b94106147986ca19a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca5f0390>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c782c10-7902-5a1b-a697-f33d692958a9/7c782c10-7902-5a1b-a697-f33d692958a9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F608%252F6778e669ed5b4b0ea5e748d87a50e306%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/608/6778e669ed5b4b0ea5e748d87a50e306/images/large/1.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c782c10-7902-5a1b-a697-f33d692958a9
2026-01-28 20:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c782c10-7902-5a1b-a697-f33d692958a9, skipping ID generation
2026-01-28 20:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c782c10-7902-5a1b-a697-f33d692958a9 with scrape type 1
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7c782c10-7902-5a1b-a697-f33d692958a9 from tracking dictionaries
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c782c10-7902-5a1b-a697-f33d692958a9 sending to next pipeline
2026-01-28 20:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7c782c10-7902-5a1b-a697-f33d692958a9, identifier: 1878425
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9150950>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3135436e-10e9-5ea3-9ac0-22370fa679b5/3135436e-10e9-5ea3-9ac0-22370fa679b5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F919%252Faf6aefde326644a5817f1e4048b38f5f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/919/af6aefde326644a5817f1e4048b38f5f/images/large/1.jpg saved to cache
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3135436e-10e9-5ea3-9ac0-22370fa679b5
2026-01-28 20:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3135436e-10e9-5ea3-9ac0-22370fa679b5, skipping ID generation
2026-01-28 20:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3135436e-10e9-5ea3-9ac0-22370fa679b5 with scrape type 1
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3135436e-10e9-5ea3-9ac0-22370fa679b5 from tracking dictionaries
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3135436e-10e9-5ea3-9ac0-22370fa679b5 sending to next pipeline
2026-01-28 20:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3135436e-10e9-5ea3-9ac0-22370fa679b5, identifier: 1878427
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/745/d67dbeb6394f4223a9662134ee682d70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7c782c10-7902-5a1b-a697-f33d692958a9 with identifier: 1878425
2026-01-28 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7c782c10-7902-5a1b-a697-f33d692958a9 with identifier: 1878425
2026-01-28 20:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7c782c10-7902-5a1b-a697-f33d692958a9 with identifier: 1878425 to the API
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/608/6778e669ed5b4b0ea5e748d87a50e306/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c782c10-7902-5a1b-a697-f33d692958a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 141518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c782c10-7902-5a1b-a697-f33d692958a9/7c782c10-7902-5a1b-a697-f33d692958a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/608/6778e669ed5b4b0ea5e748d87a50e306/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 2.0 TDI 110kW (150 CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150 CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878425%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [ayvens.es] INFO: Saving data for 1878425: {'created_time': 1769630528.69483, 'last_price_update_time': 1769630528.694839, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878425') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3135436e-10e9-5ea3-9ac0-22370fa679b5 with identifier: 1878427
2026-01-28 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3135436e-10e9-5ea3-9ac0-22370fa679b5 with identifier: 1878427
2026-01-28 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177399 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177399
2026-01-28 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3135436e-10e9-5ea3-9ac0-22370fa679b5 spider: ayvens.es
2026-01-28 20:02:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 3135436e-10e9-5ea3-9ac0-22370fa679b5 due to rule: high_mileage_for_country.json, error: 177399 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177399
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3135436e-10e9-5ea3-9ac0-22370fa679b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 177399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3135436e-10e9-5ea3-9ac0-22370fa679b5/3135436e-10e9-5ea3-9ac0-22370fa679b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/919/af6aefde326644a5817f1e4048b38f5f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Emotion',
 'vin': None,
 'year': 2022}
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878427%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [ayvens.es] INFO: Saving data for 1878427: {'created_time': 1769630528.937963, 'last_price_update_time': 1769630528.937975, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878427') HTTP/1.1" 204 0
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c916ed50>
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76586331-ab2c-5ea6-aadf-d33d77a0645f/76586331-ab2c-5ea6-aadf-d33d77a0645f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252F43ccb02532bd4de7ae0b8bf6a3e939a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/43ccb02532bd4de7ae0b8bf6a3e939a7/images/large/1.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76586331-ab2c-5ea6-aadf-d33d77a0645f
2026-01-28 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76586331-ab2c-5ea6-aadf-d33d77a0645f, skipping ID generation
2026-01-28 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76586331-ab2c-5ea6-aadf-d33d77a0645f with scrape type 1
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 76586331-ab2c-5ea6-aadf-d33d77a0645f from tracking dictionaries
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76586331-ab2c-5ea6-aadf-d33d77a0645f sending to next pipeline
2026-01-28 20:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 76586331-ab2c-5ea6-aadf-d33d77a0645f, identifier: 1878426
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9176c50>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3e2edd-236c-5371-b996-f60029bfd596/cb3e2edd-236c-5371-b996-f60029bfd596_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F000%252Fe8d700282f82402b94106147986ca19a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/000/e8d700282f82402b94106147986ca19a/images/large/1.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb3e2edd-236c-5371-b996-f60029bfd596
2026-01-28 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb3e2edd-236c-5371-b996-f60029bfd596, skipping ID generation
2026-01-28 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3e2edd-236c-5371-b996-f60029bfd596 with scrape type 1
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cb3e2edd-236c-5371-b996-f60029bfd596 from tracking dictionaries
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb3e2edd-236c-5371-b996-f60029bfd596 sending to next pipeline
2026-01-28 20:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cb3e2edd-236c-5371-b996-f60029bfd596, identifier: 1878428
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9176ed0>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ff319e9-b9e2-5fe3-948c-277303e140f9/7ff319e9-b9e2-5fe3-948c-277303e140f9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F745%252Fd67dbeb6394f4223a9662134ee682d70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/745/d67dbeb6394f4223a9662134ee682d70/images/large/1.jpg saved to cache
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ff319e9-b9e2-5fe3-948c-277303e140f9
2026-01-28 20:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ff319e9-b9e2-5fe3-948c-277303e140f9, skipping ID generation
2026-01-28 20:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ff319e9-b9e2-5fe3-948c-277303e140f9 with scrape type 1
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7ff319e9-b9e2-5fe3-948c-277303e140f9 from tracking dictionaries
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ff319e9-b9e2-5fe3-948c-277303e140f9 sending to next pipeline
2026-01-28 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ff319e9-b9e2-5fe3-948c-277303e140f9, identifier: 1878429
2026-01-28 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 76586331-ab2c-5ea6-aadf-d33d77a0645f with identifier: 1878426
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 76586331-ab2c-5ea6-aadf-d33d77a0645f with identifier: 1878426
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144610 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144610
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 76586331-ab2c-5ea6-aadf-d33d77a0645f spider: ayvens.es
2026-01-28 20:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 76586331-ab2c-5ea6-aadf-d33d77a0645f due to rule: high_mileage_for_make.json, error: 144610 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144610
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '76586331-ab2c-5ea6-aadf-d33d77a0645f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 144610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76586331-ab2c-5ea6-aadf-d33d77a0645f/76586331-ab2c-5ea6-aadf-d33d77a0645f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/012/43ccb02532bd4de7ae0b8bf6a3e939a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'SW Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878426%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [ayvens.es] INFO: Saving data for 1878426: {'created_time': 1769630530.533862, 'last_price_update_time': 1769630530.533871, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878426') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cb3e2edd-236c-5371-b996-f60029bfd596 with identifier: 1878428
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cb3e2edd-236c-5371-b996-f60029bfd596 with identifier: 1878428
2026-01-28 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cb3e2edd-236c-5371-b996-f60029bfd596 with identifier: 1878428 to the API
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/000/e8d700282f82402b94106147986ca19a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cb3e2edd-236c-5371-b996-f60029bfd596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 73988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3e2edd-236c-5371-b996-f60029bfd596/cb3e2edd-236c-5371-b996-f60029bfd596_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/000/e8d700282f82402b94106147986ca19a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878428%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [ayvens.es] INFO: Saving data for 1878428: {'created_time': 1769630530.898244, 'last_price_update_time': 1769630530.898256, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878428') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ff319e9-b9e2-5fe3-948c-277303e140f9 with identifier: 1878429
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ff319e9-b9e2-5fe3-948c-277303e140f9 with identifier: 1878429
2026-01-28 20:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7ff319e9-b9e2-5fe3-948c-277303e140f9 with identifier: 1878429 to the API
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/745/d67dbeb6394f4223a9662134ee682d70/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ff319e9-b9e2-5fe3-948c-277303e140f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 69381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ff319e9-b9e2-5fe3-948c-277303e140f9/7ff319e9-b9e2-5fe3-948c-277303e140f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/745/d67dbeb6394f4223a9662134ee682d70/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878429%27 HTTP/1.1" 200 None
2026-01-28 20:02:11 [ayvens.es] INFO: Saving data for 1878429: {'created_time': 1769630531.325677, 'last_price_update_time': 1769630531.325687, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878429') HTTP/1.1" 204 0
2026-01-28 20:02:12 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at -2 pages/min), scraped 59 items (at 41 items/min)
2026-01-28 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878430
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878430%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878430: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878430
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb072641-9110-5dca-ac5d-783edb1ba973 with identifier: 1878430
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb072641-9110-5dca-ac5d-783edb1ba973 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb072641-9110-5dca-ac5d-783edb1ba973
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F015%252Fcea5de19a8884e8ea8977762b91f2176%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/015/cea5de19a8884e8ea8977762b91f2176/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878431
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878431%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878431: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878431
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 with identifier: 1878431
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ccf58a8-4f39-5da9-b452-3c31df0d7b99
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F914%252F0264795bffbb4cebb5347954e2b3a209%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/914/0264795bffbb4cebb5347954e2b3a209/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878432
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878432%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878432: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878432
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40302179-121a-5c47-a7e9-acd35c111cf6 with identifier: 1878432
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40302179-121a-5c47-a7e9-acd35c111cf6 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40302179-121a-5c47-a7e9-acd35c111cf6
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252F8cb5dbbc90974529bd5beb771c49055e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878433
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878433%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878433: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878433
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a659b71-7772-5c12-8a47-b6435fbd2a5c with identifier: 1878433
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a659b71-7772-5c12-8a47-b6435fbd2a5c with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a659b71-7772-5c12-8a47-b6435fbd2a5c
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252F6d508b44eb314ee694469f296f597487%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878434
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878434%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878434: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878434
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37a850c-6e77-5c0d-9aab-f6dd3fa21308 with identifier: 1878434
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37a850c-6e77-5c0d-9aab-f6dd3fa21308 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e37a850c-6e77-5c0d-9aab-f6dd3fa21308
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F147%252F1fbba936d2e043c695c3661f0526d2cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878435
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878435%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878435: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878435
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a23b9ca-2330-540a-a87c-9684d6bfe872 with identifier: 1878435
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a23b9ca-2330-540a-a87c-9684d6bfe872 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5a23b9ca-2330-540a-a87c-9684d6bfe872
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F594%252F27d3da3f79c849d9880a4a48cba2ae8d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/594/27d3da3f79c849d9880a4a48cba2ae8d/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878436
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878436%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878436: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878436
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b with identifier: 1878436
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252Fc60becc6fe52468b9e193670711da921%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/c60becc6fe52468b9e193670711da921/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878437
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878437%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878437: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878437
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4184129-c3b2-5b73-b51f-5920a004d892 with identifier: 1878437
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4184129-c3b2-5b73-b51f-5920a004d892 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4184129-c3b2-5b73-b51f-5920a004d892
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F807%252Fcabdbf3e84944d0e9f05daadf580d8df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/807/cabdbf3e84944d0e9f05daadf580d8df/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/914/0264795bffbb4cebb5347954e2b3a209/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878438
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878438%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878438: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878438
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11d51a07-f4f0-5746-8481-7b2d138df825 with identifier: 1878438
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d51a07-f4f0-5746-8481-7b2d138df825 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 11d51a07-f4f0-5746-8481-7b2d138df825
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F337%252Fb18e4015eb5b4e3295751f94b7fa7ded%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/337/b18e4015eb5b4e3295751f94b7fa7ded/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878439
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878439%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878439: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878439
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 with identifier: 1878439
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F2669a617ed1942259dd7605be1ccf141%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878440
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878440%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878440: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878440
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 with identifier: 1878440
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F3b05313690d94db6b41eeaf12f5f0f0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/3b05313690d94db6b41eeaf12f5f0f0a/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/015/cea5de19a8884e8ea8977762b91f2176/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878441
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878441%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878441: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878441
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c6cf8ad-988d-5777-b644-dfe138629eae with identifier: 1878441
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c6cf8ad-988d-5777-b644-dfe138629eae with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6c6cf8ad-988d-5777-b644-dfe138629eae
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fb1172357ba6148ea93d86a2c2dfd4e13%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/b1172357ba6148ea93d86a2c2dfd4e13/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.es] INFO: Found listing with ID: 1878442
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878442%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.es] INFO: Scrape type for 1878442: 1
2026-01-28 20:02:13 [ayvens.es] INFO: Extracting data for car ID: 1878442
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f0a376-25fc-5346-a380-1b8cca006e6f with identifier: 1878442
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f0a376-25fc-5346-a380-1b8cca006e6f with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e2f0a376-25fc-5346-a380-1b8cca006e6f
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F652%252Fda21473145f14f40bea9c930bbe260ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/652/da21473145f14f40bea9c930bbe260ac/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca920110>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ccf58a8-4f39-5da9-b452-3c31df0d7b99/5ccf58a8-4f39-5da9-b452-3c31df0d7b99_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F914%252F0264795bffbb4cebb5347954e2b3a209%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/914/0264795bffbb4cebb5347954e2b3a209/images/large/1.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ccf58a8-4f39-5da9-b452-3c31df0d7b99
2026-01-28 20:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ccf58a8-4f39-5da9-b452-3c31df0d7b99, skipping ID generation
2026-01-28 20:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 with scrape type 1
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 from tracking dictionaries
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 sending to next pipeline
2026-01-28 20:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ccf58a8-4f39-5da9-b452-3c31df0d7b99, identifier: 1878431
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/594/27d3da3f79c849d9880a4a48cba2ae8d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:14 [ayvens.es] INFO: Found listing with ID: 1878443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878443%27 HTTP/1.1" 200 None
2026-01-28 20:02:14 [ayvens.es] INFO: Scrape type for 1878443: 1
2026-01-28 20:02:14 [ayvens.es] INFO: Extracting data for car ID: 1878443
2026-01-28 20:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc46b603-30f6-5624-997c-38c5294b4a1b with identifier: 1878443
2026-01-28 20:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc46b603-30f6-5624-997c-38c5294b4a1b with scrape type 1
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc46b603-30f6-5624-997c-38c5294b4a1b
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F512%252Fcb6ff783fe1046bb923796de7b501d03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/512/cb6ff783fe1046bb923796de7b501d03/images/large/1.jpg not downloaded yet
2026-01-28 20:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 with identifier: 1878431
2026-01-28 20:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 with identifier: 1878431
2026-01-28 20:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ccf58a8-4f39-5da9-b452-3c31df0d7b99 with identifier: 1878431 to the API
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/914/0264795bffbb4cebb5347954e2b3a209/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ccf58a8-4f39-5da9-b452-3c31df0d7b99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 124739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ccf58a8-4f39-5da9-b452-3c31df0d7b99/5ccf58a8-4f39-5da9-b452-3c31df0d7b99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/914/0264795bffbb4cebb5347954e2b3a209/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Life Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878431%27 HTTP/1.1" 200 None
2026-01-28 20:02:14 [ayvens.es] INFO: Saving data for 1878431: {'created_time': 1769630534.745006, 'last_price_update_time': 1769630534.745019, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878431') HTTP/1.1" 204 0
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca922f90>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb072641-9110-5dca-ac5d-783edb1ba973/eb072641-9110-5dca-ac5d-783edb1ba973_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F015%252Fcea5de19a8884e8ea8977762b91f2176%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/015/cea5de19a8884e8ea8977762b91f2176/images/large/1.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb072641-9110-5dca-ac5d-783edb1ba973
2026-01-28 20:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb072641-9110-5dca-ac5d-783edb1ba973, skipping ID generation
2026-01-28 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb072641-9110-5dca-ac5d-783edb1ba973 with scrape type 1
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eb072641-9110-5dca-ac5d-783edb1ba973 from tracking dictionaries
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb072641-9110-5dca-ac5d-783edb1ba973 sending to next pipeline
2026-01-28 20:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb072641-9110-5dca-ac5d-783edb1ba973, identifier: 1878430
2026-01-28 20:02:15 [ayvens.es] INFO: Found listing with ID: 1878444
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878444%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [ayvens.es] INFO: Scrape type for 1878444: 1
2026-01-28 20:02:15 [ayvens.es] INFO: Extracting data for car ID: 1878444
2026-01-28 20:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b9a483-e264-5fa9-ac42-39158c344731 with identifier: 1878444
2026-01-28 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b9a483-e264-5fa9-ac42-39158c344731 with scrape type 1
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 53b9a483-e264-5fa9-ac42-39158c344731
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252F31dcd672bbe248568a8330cabcaed477%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/31dcd672bbe248568a8330cabcaed477/images/large/1.jpg not downloaded yet
2026-01-28 20:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb072641-9110-5dca-ac5d-783edb1ba973 with identifier: 1878430
2026-01-28 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb072641-9110-5dca-ac5d-783edb1ba973 with identifier: 1878430
2026-01-28 20:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb072641-9110-5dca-ac5d-783edb1ba973 with identifier: 1878430 to the API
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/015/cea5de19a8884e8ea8977762b91f2176/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eb072641-9110-5dca-ac5d-783edb1ba973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 92767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb072641-9110-5dca-ac5d-783edb1ba973/eb072641-9110-5dca-ac5d-783edb1ba973_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/015/cea5de19a8884e8ea8977762b91f2176/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 Business Line BlueHDi 96kW S&S 6vel MAN',
 'transmission': 'manual',
 'trim': 'Business Line BlueHDi 96kW S&S 6vel MAN',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878430%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [ayvens.es] INFO: Saving data for 1878430: {'created_time': 1769630535.686165, 'last_price_update_time': 1769630535.686176, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878430') HTTP/1.1" 204 0
2026-01-28 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9009510>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a23b9ca-2330-540a-a87c-9684d6bfe872/5a23b9ca-2330-540a-a87c-9684d6bfe872_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F594%252F27d3da3f79c849d9880a4a48cba2ae8d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/594/27d3da3f79c849d9880a4a48cba2ae8d/images/large/1.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a23b9ca-2330-540a-a87c-9684d6bfe872
2026-01-28 20:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a23b9ca-2330-540a-a87c-9684d6bfe872, skipping ID generation
2026-01-28 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a23b9ca-2330-540a-a87c-9684d6bfe872 with scrape type 1
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5a23b9ca-2330-540a-a87c-9684d6bfe872 from tracking dictionaries
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a23b9ca-2330-540a-a87c-9684d6bfe872 sending to next pipeline
2026-01-28 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5a23b9ca-2330-540a-a87c-9684d6bfe872, identifier: 1878435
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/057/c60becc6fe52468b9e193670711da921/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [ayvens.es] INFO: Found listing with ID: 1878445
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878445%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [ayvens.es] INFO: Scrape type for 1878445: 1
2026-01-28 20:02:16 [ayvens.es] INFO: Extracting data for car ID: 1878445
2026-01-28 20:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 298e1b4d-210b-5bef-bd86-325eb7f39a10 with identifier: 1878445
2026-01-28 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 298e1b4d-210b-5bef-bd86-325eb7f39a10 with scrape type 1
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 298e1b4d-210b-5bef-bd86-325eb7f39a10
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F261%252F9624a8d04495481fb7c2d8e3489c0d44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/261/9624a8d04495481fb7c2d8e3489c0d44/images/large/1.jpg not downloaded yet
2026-01-28 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5a23b9ca-2330-540a-a87c-9684d6bfe872 with identifier: 1878435
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5a23b9ca-2330-540a-a87c-9684d6bfe872 with identifier: 1878435
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195229 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195229
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5a23b9ca-2330-540a-a87c-9684d6bfe872 spider: ayvens.es
2026-01-28 20:02:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 5a23b9ca-2330-540a-a87c-9684d6bfe872 due to rule: high_mileage_for_country.json, error: 195229 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195229
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5a23b9ca-2330-540a-a87c-9684d6bfe872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 195229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a23b9ca-2330-540a-a87c-9684d6bfe872/5a23b9ca-2330-540a-a87c-9684d6bfe872_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/594/27d3da3f79c849d9880a4a48cba2ae8d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW (115CV) St&Sp Style',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW (115CV) St&Sp Style',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878435%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [ayvens.es] INFO: Saving data for 1878435: {'created_time': 1769630536.353796, 'last_price_update_time': 1769630536.353807, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878435') HTTP/1.1" 204 0
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/807/cabdbf3e84944d0e9f05daadf580d8df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca272c50>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a659b71-7772-5c12-8a47-b6435fbd2a5c/0a659b71-7772-5c12-8a47-b6435fbd2a5c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252F6d508b44eb314ee694469f296f597487%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a659b71-7772-5c12-8a47-b6435fbd2a5c
2026-01-28 20:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a659b71-7772-5c12-8a47-b6435fbd2a5c, skipping ID generation
2026-01-28 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a659b71-7772-5c12-8a47-b6435fbd2a5c with scrape type 1
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0a659b71-7772-5c12-8a47-b6435fbd2a5c from tracking dictionaries
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a659b71-7772-5c12-8a47-b6435fbd2a5c sending to next pipeline
2026-01-28 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a659b71-7772-5c12-8a47-b6435fbd2a5c, identifier: 1878433
2026-01-28 20:02:16 [ayvens.es] INFO: Found listing with ID: 1878446
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878446%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [ayvens.es] INFO: Scrape type for 1878446: 1
2026-01-28 20:02:16 [ayvens.es] INFO: Extracting data for car ID: 1878446
2026-01-28 20:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c448d98-7975-5fe6-82ce-a65fa93924ca with identifier: 1878446
2026-01-28 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c448d98-7975-5fe6-82ce-a65fa93924ca with scrape type 1
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c448d98-7975-5fe6-82ce-a65fa93924ca
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F702%252Fc2a4e74567f94427977e31eca6eb2e85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/702/c2a4e74567f94427977e31eca6eb2e85/images/large/1.jpg not downloaded yet
2026-01-28 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a659b71-7772-5c12-8a47-b6435fbd2a5c with identifier: 1878433
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a659b71-7772-5c12-8a47-b6435fbd2a5c with identifier: 1878433
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': 'sp 2.0 tdi 85kw style go', 'title': 'seat leon sp 2.0 tdi 85kw style go', 'price': 0, 'odometer': 220114, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-26', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 114, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0a659b71-7772-5c12-8a47-b6435fbd2a5c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a659b71-7772-5c12-8a47-b6435fbd2a5c/0a659b71-7772-5c12-8a47-b6435fbd2a5c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 383122}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 220114}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '0a659b71-7772-5c12-8a47-b6435fbd2a5c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 220114,
     'odometer_in_km': 220114,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a659b71-7772-5c12-8a47-b6435fbd2a5c/0a659b71-7772-5c12-8a47-b6435fbd2a5c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 383122,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon sp 2.0 tdi 85kw style go',
     'transmission': 'manual',
     'trim': 'sp 2.0 tdi 85kw style go',
     'vin': None,
     'year': 2021}
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 0a659b71-7772-5c12-8a47-b6435fbd2a5c spider: ayvens.es
2026-01-28 20:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0a659b71-7772-5c12-8a47-b6435fbd2a5c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': 'sp 2.0 tdi 85kw style go', 'title': 'seat leon sp 2.0 tdi 85kw style go', 'price': 0, 'odometer': 220114, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-26', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 114, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0a659b71-7772-5c12-8a47-b6435fbd2a5c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a659b71-7772-5c12-8a47-b6435fbd2a5c/0a659b71-7772-5c12-8a47-b6435fbd2a5c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 383122}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 220114}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '0a659b71-7772-5c12-8a47-b6435fbd2a5c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 220114,
     'odometer_in_km': 220114,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a659b71-7772-5c12-8a47-b6435fbd2a5c/0a659b71-7772-5c12-8a47-b6435fbd2a5c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 383122,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon sp 2.0 tdi 85kw style go',
     'transmission': 'manual',
     'trim': 'sp 2.0 tdi 85kw style go',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a659b71-7772-5c12-8a47-b6435fbd2a5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 220114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a659b71-7772-5c12-8a47-b6435fbd2a5c/0a659b71-7772-5c12-8a47-b6435fbd2a5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/6d508b44eb314ee694469f296f597487/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878433%27 HTTP/1.1" 200 None
2026-01-28 20:02:17 [ayvens.es] INFO: Saving data for 1878433: {'created_time': 1769630537.09613, 'last_price_update_time': 1769630537.096142, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878433') HTTP/1.1" 204 0
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca5f10d0>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40302179-121a-5c47-a7e9-acd35c111cf6/40302179-121a-5c47-a7e9-acd35c111cf6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252F8cb5dbbc90974529bd5beb771c49055e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40302179-121a-5c47-a7e9-acd35c111cf6
2026-01-28 20:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40302179-121a-5c47-a7e9-acd35c111cf6, skipping ID generation
2026-01-28 20:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40302179-121a-5c47-a7e9-acd35c111cf6 with scrape type 1
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40302179-121a-5c47-a7e9-acd35c111cf6 from tracking dictionaries
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40302179-121a-5c47-a7e9-acd35c111cf6 sending to next pipeline
2026-01-28 20:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 40302179-121a-5c47-a7e9-acd35c111cf6, identifier: 1878432
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91045d0>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e42239f-bbfd-5602-8e4f-0d6bd7680d4b/0e42239f-bbfd-5602-8e4f-0d6bd7680d4b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252Fc60becc6fe52468b9e193670711da921%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/c60becc6fe52468b9e193670711da921/images/large/1.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b
2026-01-28 20:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b, skipping ID generation
2026-01-28 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b with scrape type 1
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b from tracking dictionaries
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b sending to next pipeline
2026-01-28 20:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b, identifier: 1878436
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91321d0>
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1/e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F2669a617ed1942259dd7605be1ccf141%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1
2026-01-28 20:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1, skipping ID generation
2026-01-28 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 with scrape type 1
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 from tracking dictionaries
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 sending to next pipeline
2026-01-28 20:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1, identifier: 1878439
2026-01-28 20:02:18 [ayvens.es] INFO: Found listing with ID: 1878447
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878447%27 HTTP/1.1" 200 None
2026-01-28 20:02:18 [ayvens.es] INFO: Scrape type for 1878447: 1
2026-01-28 20:02:18 [ayvens.es] INFO: Extracting data for car ID: 1878447
2026-01-28 20:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 376c43d4-682d-5495-8d55-8f0954c5fa9d with identifier: 1878447
2026-01-28 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 376c43d4-682d-5495-8d55-8f0954c5fa9d with scrape type 1
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 376c43d4-682d-5495-8d55-8f0954c5fa9d
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252F7a2efdef24164c8e955bdf1f4c7fd8d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/7a2efdef24164c8e955bdf1f4c7fd8d6/images/large/1.jpg not downloaded yet
2026-01-28 20:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 40302179-121a-5c47-a7e9-acd35c111cf6 with identifier: 1878432
2026-01-28 20:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 40302179-121a-5c47-a7e9-acd35c111cf6 with identifier: 1878432
2026-01-28 20:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 36450, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-28', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '40302179-121a-5c47-a7e9-acd35c111cf6', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40302179-121a-5c47-a7e9-acd35c111cf6/40302179-121a-5c47-a7e9-acd35c111cf6_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 468678}], 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 36450}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': '40302179-121a-5c47-a7e9-acd35c111cf6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 36450,
     'odometer_in_km': 36450,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40302179-121a-5c47-a7e9-acd35c111cf6/40302179-121a-5c47-a7e9-acd35c111cf6_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 468678,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
2026-01-28 20:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 40302179-121a-5c47-a7e9-acd35c111cf6 spider: ayvens.es
2026-01-28 20:02:18 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 40302179-121a-5c47-a7e9-acd35c111cf6 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 36450, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-28', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '40302179-121a-5c47-a7e9-acd35c111cf6', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40302179-121a-5c47-a7e9-acd35c111cf6/40302179-121a-5c47-a7e9-acd35c111cf6_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 468678}], 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 36450}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': '40302179-121a-5c47-a7e9-acd35c111cf6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 36450,
     'odometer_in_km': 36450,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40302179-121a-5c47-a7e9-acd35c111cf6/40302179-121a-5c47-a7e9-acd35c111cf6_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 468678,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '40302179-121a-5c47-a7e9-acd35c111cf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 36450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40302179-121a-5c47-a7e9-acd35c111cf6/40302179-121a-5c47-a7e9-acd35c111cf6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/8cb5dbbc90974529bd5beb771c49055e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878432%27 HTTP/1.1" 200 None
2026-01-28 20:02:19 [ayvens.es] INFO: Saving data for 1878432: {'created_time': 1769630539.016051, 'last_price_update_time': 1769630539.016061, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878432') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b with identifier: 1878436
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b with identifier: 1878436
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166091 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166091
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b spider: ayvens.es
2026-01-28 20:02:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0e42239f-bbfd-5602-8e4f-0d6bd7680d4b due to rule: high_mileage_for_country.json, error: 166091 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166091
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e42239f-bbfd-5602-8e4f-0d6bd7680d4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 166091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e42239f-bbfd-5602-8e4f-0d6bd7680d4b/0e42239f-bbfd-5602-8e4f-0d6bd7680d4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/057/c60becc6fe52468b9e193670711da921/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW St&Sp Reference Plus',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW St&Sp Reference Plus',
 'vin': None,
 'year': 2018}
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878436%27 HTTP/1.1" 200 None
2026-01-28 20:02:19 [ayvens.es] INFO: Saving data for 1878436: {'created_time': 1769630539.277296, 'last_price_update_time': 1769630539.277309, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878436') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 with identifier: 1878439
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 with identifier: 1878439
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'nissan', 'model': 'qashqai', 'trim': 'dci 150cv (110kw) 4wd acenta', 'title': 'nissan qashqai dci 150cv (110kw) 4wd acenta', 'price': 0, 'odometer': 204041, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-23', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.7l', 'c_o_2_emission_value': 135, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1/e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338133}], 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 204041}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.7l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 204041,
     'odometer_in_km': 204041,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1/e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 338133,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-07-23',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan qashqai dci 150cv (110kw) 4wd acenta',
     'transmission': 'manual',
     'trim': 'dci 150cv (110kw) 4wd acenta',
     'vin': None,
     'year': 2020}
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 spider: ayvens.es
2026-01-28 20:02:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'nissan', 'model': 'qashqai', 'trim': 'dci 150cv (110kw) 4wd acenta', 'title': 'nissan qashqai dci 150cv (110kw) 4wd acenta', 'price': 0, 'odometer': 204041, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-23', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.7l', 'c_o_2_emission_value': 135, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1/e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338133}], 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 204041}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.7l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 204041,
     'odometer_in_km': 204041,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1/e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 338133,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-07-23',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan qashqai dci 150cv (110kw) 4wd acenta',
     'transmission': 'manual',
     'trim': 'dci 150cv (110kw) 4wd acenta',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 204041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1/e2bf5ce1-d062-5f64-9ace-3b05eaf63ba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/2669a617ed1942259dd7605be1ccf141/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 150CV (110kW) 4WD ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 150CV (110kW) 4WD ACENTA',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878439%27 HTTP/1.1" 200 None
2026-01-28 20:02:19 [ayvens.es] INFO: Saving data for 1878439: {'created_time': 1769630539.519291, 'last_price_update_time': 1769630539.519304, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878439') HTTP/1.1" 204 0
2026-01-28 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/337/b18e4015eb5b4e3295751f94b7fa7ded/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/705/3b05313690d94db6b41eeaf12f5f0f0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9161fd0>
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4184129-c3b2-5b73-b51f-5920a004d892/b4184129-c3b2-5b73-b51f-5920a004d892_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F807%252Fcabdbf3e84944d0e9f05daadf580d8df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/807/cabdbf3e84944d0e9f05daadf580d8df/images/large/1.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4184129-c3b2-5b73-b51f-5920a004d892
2026-01-28 20:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4184129-c3b2-5b73-b51f-5920a004d892, skipping ID generation
2026-01-28 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4184129-c3b2-5b73-b51f-5920a004d892 with scrape type 1
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b4184129-c3b2-5b73-b51f-5920a004d892 from tracking dictionaries
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4184129-c3b2-5b73-b51f-5920a004d892 sending to next pipeline
2026-01-28 20:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4184129-c3b2-5b73-b51f-5920a004d892, identifier: 1878437
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fdd890>
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37a850c-6e77-5c0d-9aab-f6dd3fa21308/e37a850c-6e77-5c0d-9aab-f6dd3fa21308_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F147%252F1fbba936d2e043c695c3661f0526d2cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg saved to cache
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e37a850c-6e77-5c0d-9aab-f6dd3fa21308
2026-01-28 20:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e37a850c-6e77-5c0d-9aab-f6dd3fa21308, skipping ID generation
2026-01-28 20:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37a850c-6e77-5c0d-9aab-f6dd3fa21308 with scrape type 1
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e37a850c-6e77-5c0d-9aab-f6dd3fa21308 from tracking dictionaries
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e37a850c-6e77-5c0d-9aab-f6dd3fa21308 sending to next pipeline
2026-01-28 20:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e37a850c-6e77-5c0d-9aab-f6dd3fa21308, identifier: 1878434
2026-01-28 20:02:20 [ayvens.es] INFO: Found listing with ID: 1878448
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878448%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [ayvens.es] INFO: Scrape type for 1878448: 1
2026-01-28 20:02:20 [ayvens.es] INFO: Extracting data for car ID: 1878448
2026-01-28 20:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49bb2ede-2f9b-591d-83d6-f891776bcf44 with identifier: 1878448
2026-01-28 20:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49bb2ede-2f9b-591d-83d6-f891776bcf44 with scrape type 1
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49bb2ede-2f9b-591d-83d6-f891776bcf44
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F8e8b67469612482c9c1906ebe65b76ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/8e8b67469612482c9c1906ebe65b76ec/images/large/1.jpg not downloaded yet
2026-01-28 20:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4184129-c3b2-5b73-b51f-5920a004d892 with identifier: 1878437
2026-01-28 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4184129-c3b2-5b73-b51f-5920a004d892 with identifier: 1878437
2026-01-28 20:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4184129-c3b2-5b73-b51f-5920a004d892 with identifier: 1878437 to the API
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/807/cabdbf3e84944d0e9f05daadf580d8df/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b4184129-c3b2-5b73-b51f-5920a004d892',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 83754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4184129-c3b2-5b73-b51f-5920a004d892/b4184129-c3b2-5b73-b51f-5920a004d892_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/807/cabdbf3e84944d0e9f05daadf580d8df/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103 kW (140 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'DIG-T 103 kW (140 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878437%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [ayvens.es] INFO: Saving data for 1878437: {'created_time': 1769630540.825926, 'last_price_update_time': 1769630540.825938, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878437') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e37a850c-6e77-5c0d-9aab-f6dd3fa21308 with identifier: 1878434
2026-01-28 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e37a850c-6e77-5c0d-9aab-f6dd3fa21308 with identifier: 1878434
2026-01-28 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': 'sp 2.0 tdi 85kw style go', 'title': 'seat leon sp 2.0 tdi 85kw style go', 'price': 0, 'odometer': 248066, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-26', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 114, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e37a850c-6e77-5c0d-9aab-f6dd3fa21308', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a850c-6e77-5c0d-9aab-f6dd3fa21308/e37a850c-6e77-5c0d-9aab-f6dd3fa21308_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458952}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 248066}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'e37a850c-6e77-5c0d-9aab-f6dd3fa21308',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 248066,
     'odometer_in_km': 248066,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a850c-6e77-5c0d-9aab-f6dd3fa21308/e37a850c-6e77-5c0d-9aab-f6dd3fa21308_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 458952,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon sp 2.0 tdi 85kw style go',
     'transmission': 'manual',
     'trim': 'sp 2.0 tdi 85kw style go',
     'vin': None,
     'year': 2021}
2026-01-28 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: e37a850c-6e77-5c0d-9aab-f6dd3fa21308 spider: ayvens.es
2026-01-28 20:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e37a850c-6e77-5c0d-9aab-f6dd3fa21308 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'seat', 'model': 'leon', 'trim': 'sp 2.0 tdi 85kw style go', 'title': 'seat leon sp 2.0 tdi 85kw style go', 'price': 0, 'odometer': 248066, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-26', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 114, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e37a850c-6e77-5c0d-9aab-f6dd3fa21308', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a850c-6e77-5c0d-9aab-f6dd3fa21308/e37a850c-6e77-5c0d-9aab-f6dd3fa21308_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458952}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'seat leon', 'sanitized_make': 'seat', 'odometer_in_km': 248066}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'e37a850c-6e77-5c0d-9aab-f6dd3fa21308',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'seat',
     'make_model': 'seat leon',
     'model': 'leon',
     'odometer': 248066,
     'odometer_in_km': 248066,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a850c-6e77-5c0d-9aab-f6dd3fa21308/e37a850c-6e77-5c0d-9aab-f6dd3fa21308_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 458952,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'seat',
     'seats_number': 5,
     'seller_name': None,
     'title': 'seat leon sp 2.0 tdi 85kw style go',
     'transmission': 'manual',
     'trim': 'sp 2.0 tdi 85kw style go',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e37a850c-6e77-5c0d-9aab-f6dd3fa21308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 248066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a850c-6e77-5c0d-9aab-f6dd3fa21308/e37a850c-6e77-5c0d-9aab-f6dd3fa21308_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/147/1fbba936d2e043c695c3661f0526d2cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878434%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [ayvens.es] INFO: Saving data for 1878434: {'created_time': 1769630541.096584, 'last_price_update_time': 1769630541.096596, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878434') HTTP/1.1" 204 0
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/652/da21473145f14f40bea9c930bbe260ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/512/cb6ff783fe1046bb923796de7b501d03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [ayvens.es] INFO: Found listing with ID: 1878449
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878449%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [ayvens.es] INFO: Scrape type for 1878449: 1
2026-01-28 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1878449
2026-01-28 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c with identifier: 1878449
2026-01-28 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c with scrape type 1
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F676%252Fd3a64b26081c4a80b159f2d9b68c02dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/676/d3a64b26081c4a80b159f2d9b68c02dd/images/large/1.jpg not downloaded yet
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/192/b1172357ba6148ea93d86a2c2dfd4e13/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/861/31dcd672bbe248568a8330cabcaed477/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fcc990>
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d51a07-f4f0-5746-8481-7b2d138df825/11d51a07-f4f0-5746-8481-7b2d138df825_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F337%252Fb18e4015eb5b4e3295751f94b7fa7ded%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/337/b18e4015eb5b4e3295751f94b7fa7ded/images/large/1.jpg saved to cache
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11d51a07-f4f0-5746-8481-7b2d138df825
2026-01-28 20:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11d51a07-f4f0-5746-8481-7b2d138df825, skipping ID generation
2026-01-28 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d51a07-f4f0-5746-8481-7b2d138df825 with scrape type 1
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 11d51a07-f4f0-5746-8481-7b2d138df825 from tracking dictionaries
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11d51a07-f4f0-5746-8481-7b2d138df825 sending to next pipeline
2026-01-28 20:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 11d51a07-f4f0-5746-8481-7b2d138df825, identifier: 1878438
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912bbd0>
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18/d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F3b05313690d94db6b41eeaf12f5f0f0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/3b05313690d94db6b41eeaf12f5f0f0a/images/large/1.jpg saved to cache
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18
2026-01-28 20:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18, skipping ID generation
2026-01-28 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 with scrape type 1
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 from tracking dictionaries
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 sending to next pipeline
2026-01-28 20:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18, identifier: 1878440
2026-01-28 20:02:22 [ayvens.es] INFO: Found listing with ID: 1878450
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878450%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [ayvens.es] INFO: Scrape type for 1878450: 1
2026-01-28 20:02:22 [ayvens.es] INFO: Extracting data for car ID: 1878450
2026-01-28 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84acb2f9-3122-590b-b25c-8c9557d2fee1 with identifier: 1878450
2026-01-28 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84acb2f9-3122-590b-b25c-8c9557d2fee1 with scrape type 1
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84acb2f9-3122-590b-b25c-8c9557d2fee1
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252Fbab9c1ffb7e94eef8ba6026bf50ad06e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/bab9c1ffb7e94eef8ba6026bf50ad06e/images/large/1.jpg not downloaded yet
2026-01-28 20:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 11d51a07-f4f0-5746-8481-7b2d138df825 with identifier: 1878438
2026-01-28 20:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 11d51a07-f4f0-5746-8481-7b2d138df825 with identifier: 1878438
2026-01-28 20:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 11d51a07-f4f0-5746-8481-7b2d138df825 with identifier: 1878438 to the API
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/337/b18e4015eb5b4e3295751f94b7fa7ded/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '11d51a07-f4f0-5746-8481-7b2d138df825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 98788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d51a07-f4f0-5746-8481-7b2d138df825/11d51a07-f4f0-5746-8481-7b2d138df825_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/337/b18e4015eb5b4e3295751f94b7fa7ded/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878438%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [ayvens.es] INFO: Saving data for 1878438: {'created_time': 1769630542.508124, 'last_price_update_time': 1769630542.508134, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878438') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 with identifier: 1878440
2026-01-28 20:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 with identifier: 1878440
2026-01-28 20:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18 with identifier: 1878440 to the API
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/705/3b05313690d94db6b41eeaf12f5f0f0a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd22c52d9-acb1-5ba2-8d20-8a1bb7b02a18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'ALFA ROMEO',
 'model': 'STELVIO',
 'odometer': 84628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18/d22c52d9-acb1-5ba2-8d20-8a1bb7b02a18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/705/3b05313690d94db6b41eeaf12f5f0f0a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'ALFA ROMEO STELVIO 2.2 Diesel 140kW (190CV) Sprint+ Q4',
 'transmission': 'manual',
 'trim': '2.2 Diesel 140kW (190CV) Sprint+ Q4',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878440%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [ayvens.es] INFO: Saving data for 1878440: {'created_time': 1769630542.907469, 'last_price_update_time': 1769630542.907481, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878440') HTTP/1.1" 204 0
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/261/9624a8d04495481fb7c2d8e3489c0d44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [ayvens.es] INFO: Found listing with ID: 1878451
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878451%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [ayvens.es] INFO: Scrape type for 1878451: 1
2026-01-28 20:02:22 [ayvens.es] INFO: Extracting data for car ID: 1878451
2026-01-28 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7788e781-be6c-5620-9e76-0e3bdfdd1a3c with identifier: 1878451
2026-01-28 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7788e781-be6c-5620-9e76-0e3bdfdd1a3c with scrape type 1
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7788e781-be6c-5620-9e76-0e3bdfdd1a3c
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F408%252F1adebd7f1d554acba07c3f344bb68c74%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/408/1adebd7f1d554acba07c3f344bb68c74/images/large/1.jpg not downloaded yet
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca602a10>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f0a376-25fc-5346-a380-1b8cca006e6f/e2f0a376-25fc-5346-a380-1b8cca006e6f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F652%252Fda21473145f14f40bea9c930bbe260ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/652/da21473145f14f40bea9c930bbe260ac/images/large/1.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2f0a376-25fc-5346-a380-1b8cca006e6f
2026-01-28 20:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2f0a376-25fc-5346-a380-1b8cca006e6f, skipping ID generation
2026-01-28 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f0a376-25fc-5346-a380-1b8cca006e6f with scrape type 1
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e2f0a376-25fc-5346-a380-1b8cca006e6f from tracking dictionaries
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2f0a376-25fc-5346-a380-1b8cca006e6f sending to next pipeline
2026-01-28 20:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e2f0a376-25fc-5346-a380-1b8cca006e6f, identifier: 1878442
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca906d10>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc46b603-30f6-5624-997c-38c5294b4a1b/fc46b603-30f6-5624-997c-38c5294b4a1b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F512%252Fcb6ff783fe1046bb923796de7b501d03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/512/cb6ff783fe1046bb923796de7b501d03/images/large/1.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc46b603-30f6-5624-997c-38c5294b4a1b
2026-01-28 20:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc46b603-30f6-5624-997c-38c5294b4a1b, skipping ID generation
2026-01-28 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc46b603-30f6-5624-997c-38c5294b4a1b with scrape type 1
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc46b603-30f6-5624-997c-38c5294b4a1b from tracking dictionaries
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc46b603-30f6-5624-997c-38c5294b4a1b sending to next pipeline
2026-01-28 20:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fc46b603-30f6-5624-997c-38c5294b4a1b, identifier: 1878443
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca24ee90>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c6cf8ad-988d-5777-b644-dfe138629eae/6c6cf8ad-988d-5777-b644-dfe138629eae_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fb1172357ba6148ea93d86a2c2dfd4e13%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/b1172357ba6148ea93d86a2c2dfd4e13/images/large/1.jpg saved to cache
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c6cf8ad-988d-5777-b644-dfe138629eae
2026-01-28 20:02:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c6cf8ad-988d-5777-b644-dfe138629eae, skipping ID generation
2026-01-28 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c6cf8ad-988d-5777-b644-dfe138629eae with scrape type 1
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6c6cf8ad-988d-5777-b644-dfe138629eae from tracking dictionaries
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c6cf8ad-988d-5777-b644-dfe138629eae sending to next pipeline
2026-01-28 20:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6c6cf8ad-988d-5777-b644-dfe138629eae, identifier: 1878441
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca29c7d0>
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b9a483-e264-5fa9-ac42-39158c344731/53b9a483-e264-5fa9-ac42-39158c344731_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252F31dcd672bbe248568a8330cabcaed477%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/31dcd672bbe248568a8330cabcaed477/images/large/1.jpg saved to cache
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53b9a483-e264-5fa9-ac42-39158c344731
2026-01-28 20:02:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53b9a483-e264-5fa9-ac42-39158c344731, skipping ID generation
2026-01-28 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b9a483-e264-5fa9-ac42-39158c344731 with scrape type 1
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 53b9a483-e264-5fa9-ac42-39158c344731 from tracking dictionaries
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53b9a483-e264-5fa9-ac42-39158c344731 sending to next pipeline
2026-01-28 20:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 53b9a483-e264-5fa9-ac42-39158c344731, identifier: 1878444
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/702/c2a4e74567f94427977e31eca6eb2e85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e2f0a376-25fc-5346-a380-1b8cca006e6f with identifier: 1878442
2026-01-28 20:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e2f0a376-25fc-5346-a380-1b8cca006e6f with identifier: 1878442
2026-01-28 20:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e2f0a376-25fc-5346-a380-1b8cca006e6f with identifier: 1878442 to the API
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/652/da21473145f14f40bea9c930bbe260ac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e2f0a376-25fc-5346-a380-1b8cca006e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 119193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f0a376-25fc-5346-a380-1b8cca006e6f/e2f0a376-25fc-5346-a380-1b8cca006e6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/652/da21473145f14f40bea9c930bbe260ac/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878442%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [ayvens.es] INFO: Saving data for 1878442: {'created_time': 1769630545.140864, 'last_price_update_time': 1769630545.140877, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878442') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fc46b603-30f6-5624-997c-38c5294b4a1b with identifier: 1878443
2026-01-28 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fc46b603-30f6-5624-997c-38c5294b4a1b with identifier: 1878443
2026-01-28 20:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fc46b603-30f6-5624-997c-38c5294b4a1b with identifier: 1878443 to the API
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/512/cb6ff783fe1046bb923796de7b501d03/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Urban',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fc46b603-30f6-5624-997c-38c5294b4a1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 51914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc46b603-30f6-5624-997c-38c5294b4a1b/fc46b603-30f6-5624-997c-38c5294b4a1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/512/cb6ff783fe1046bb923796de7b501d03/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2023}
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878443%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [ayvens.es] INFO: Saving data for 1878443: {'created_time': 1769630545.516679, 'last_price_update_time': 1769630545.516692, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878443') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6c6cf8ad-988d-5777-b644-dfe138629eae with identifier: 1878441
2026-01-28 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6c6cf8ad-988d-5777-b644-dfe138629eae with identifier: 1878441
2026-01-28 20:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6c6cf8ad-988d-5777-b644-dfe138629eae with identifier: 1878441 to the API
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/192/b1172357ba6148ea93d86a2c2dfd4e13/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6c6cf8ad-988d-5777-b644-dfe138629eae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 24051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c6cf8ad-988d-5777-b644-dfe138629eae/6c6cf8ad-988d-5777-b644-dfe138629eae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/192/b1172357ba6148ea93d86a2c2dfd4e13/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.0 TSI 81kW S&S Style 25 Aniversario',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW S&S Style 25 Aniversario',
 'vin': None,
 'year': 2024}
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878441%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [ayvens.es] INFO: Saving data for 1878441: {'created_time': 1769630545.883514, 'last_price_update_time': 1769630545.883527, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878441') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 53b9a483-e264-5fa9-ac42-39158c344731 with identifier: 1878444
2026-01-28 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 53b9a483-e264-5fa9-ac42-39158c344731 with identifier: 1878444
2026-01-28 20:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 53b9a483-e264-5fa9-ac42-39158c344731 with identifier: 1878444 to the API
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/861/31dcd672bbe248568a8330cabcaed477/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '53b9a483-e264-5fa9-ac42-39158c344731',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 95680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b9a483-e264-5fa9-ac42-39158c344731/53b9a483-e264-5fa9-ac42-39158c344731_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/861/31dcd672bbe248568a8330cabcaed477/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878444%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [ayvens.es] INFO: Saving data for 1878444: {'created_time': 1769630546.272265, 'last_price_update_time': 1769630546.272278, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878444') HTTP/1.1" 204 0
2026-01-28 20:02:26 [ayvens.es] INFO: Found listing with ID: 1878452
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878452%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [ayvens.es] INFO: Scrape type for 1878452: 1
2026-01-28 20:02:26 [ayvens.es] INFO: Extracting data for car ID: 1878452
2026-01-28 20:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c9a5d3-29af-5123-af4c-0470a7330915 with identifier: 1878452
2026-01-28 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c9a5d3-29af-5123-af4c-0470a7330915 with scrape type 1
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94c9a5d3-29af-5123-af4c-0470a7330915
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F767%252Fc2945db9689e491e8227b41f0defba38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg not downloaded yet
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca29a7d0>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_298e1b4d-210b-5bef-bd86-325eb7f39a10/298e1b4d-210b-5bef-bd86-325eb7f39a10_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F261%252F9624a8d04495481fb7c2d8e3489c0d44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/261/9624a8d04495481fb7c2d8e3489c0d44/images/large/1.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 298e1b4d-210b-5bef-bd86-325eb7f39a10
2026-01-28 20:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 298e1b4d-210b-5bef-bd86-325eb7f39a10, skipping ID generation
2026-01-28 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 298e1b4d-210b-5bef-bd86-325eb7f39a10 with scrape type 1
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 298e1b4d-210b-5bef-bd86-325eb7f39a10 from tracking dictionaries
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 298e1b4d-210b-5bef-bd86-325eb7f39a10 sending to next pipeline
2026-01-28 20:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 298e1b4d-210b-5bef-bd86-325eb7f39a10, identifier: 1878445
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/449/7a2efdef24164c8e955bdf1f4c7fd8d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [ayvens.es] INFO: Found listing with ID: 1878453
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878453%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [ayvens.es] INFO: Scrape type for 1878453: 1
2026-01-28 20:02:26 [ayvens.es] INFO: Extracting data for car ID: 1878453
2026-01-28 20:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043e313e-ec19-5cb7-8e54-0a459a1f9bcc with identifier: 1878453
2026-01-28 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043e313e-ec19-5cb7-8e54-0a459a1f9bcc with scrape type 1
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 043e313e-ec19-5cb7-8e54-0a459a1f9bcc
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F169%252F49ea4c18122446fdb55a7a69a28357e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/169/49ea4c18122446fdb55a7a69a28357e2/images/large/1.jpg not downloaded yet
2026-01-28 20:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 298e1b4d-210b-5bef-bd86-325eb7f39a10 with identifier: 1878445
2026-01-28 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 298e1b4d-210b-5bef-bd86-325eb7f39a10 with identifier: 1878445
2026-01-28 20:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 298e1b4d-210b-5bef-bd86-325eb7f39a10 with identifier: 1878445 to the API
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/261/9624a8d04495481fb7c2d8e3489c0d44/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '298e1b4d-210b-5bef-bd86-325eb7f39a10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'ALFA ROMEO',
 'model': 'STELVIO',
 'odometer': 42698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298e1b4d-210b-5bef-bd86-325eb7f39a10/298e1b4d-210b-5bef-bd86-325eb7f39a10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/261/9624a8d04495481fb7c2d8e3489c0d44/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'ALFA ROMEO STELVIO 2.2 Diesel 140kW (190CV) Sprint RWD',
 'transmission': 'manual',
 'trim': '2.2 Diesel 140kW (190CV) Sprint RWD',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878445%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [ayvens.es] INFO: Saving data for 1878445: {'created_time': 1769630547.217235, 'last_price_update_time': 1769630547.21725, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878445') HTTP/1.1" 204 0
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca239010>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c448d98-7975-5fe6-82ce-a65fa93924ca/0c448d98-7975-5fe6-82ce-a65fa93924ca_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F702%252Fc2a4e74567f94427977e31eca6eb2e85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/702/c2a4e74567f94427977e31eca6eb2e85/images/large/1.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c448d98-7975-5fe6-82ce-a65fa93924ca
2026-01-28 20:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c448d98-7975-5fe6-82ce-a65fa93924ca, skipping ID generation
2026-01-28 20:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c448d98-7975-5fe6-82ce-a65fa93924ca with scrape type 1
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0c448d98-7975-5fe6-82ce-a65fa93924ca from tracking dictionaries
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c448d98-7975-5fe6-82ce-a65fa93924ca sending to next pipeline
2026-01-28 20:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c448d98-7975-5fe6-82ce-a65fa93924ca, identifier: 1878446
2026-01-28 20:02:27 [ayvens.es] INFO: Found listing with ID: 1878454
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878454%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [ayvens.es] INFO: Scrape type for 1878454: 1
2026-01-28 20:02:27 [ayvens.es] INFO: Extracting data for car ID: 1878454
2026-01-28 20:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fecb344-051e-5564-b6f8-b0a94ab07fca with identifier: 1878454
2026-01-28 20:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fecb344-051e-5564-b6f8-b0a94ab07fca with scrape type 1
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6fecb344-051e-5564-b6f8-b0a94ab07fca
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252F94b54ebed98e4d6c850ce5fac2105a4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg not downloaded yet
2026-01-28 20:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c448d98-7975-5fe6-82ce-a65fa93924ca with identifier: 1878446
2026-01-28 20:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c448d98-7975-5fe6-82ce-a65fa93924ca with identifier: 1878446
2026-01-28 20:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c448d98-7975-5fe6-82ce-a65fa93924ca with identifier: 1878446 to the API
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/702/c2a4e74567f94427977e31eca6eb2e85/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c448d98-7975-5fe6-82ce-a65fa93924ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 118441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c448d98-7975-5fe6-82ce-a65fa93924ca/0c448d98-7975-5fe6-82ce-a65fa93924ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/702/c2a4e74567f94427977e31eca6eb2e85/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878446%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [ayvens.es] INFO: Saving data for 1878446: {'created_time': 1769630548.05652, 'last_price_update_time': 1769630548.056532, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878446') HTTP/1.1" 204 0
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/482/8e8b67469612482c9c1906ebe65b76ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1edb50>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_376c43d4-682d-5495-8d55-8f0954c5fa9d/376c43d4-682d-5495-8d55-8f0954c5fa9d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252F7a2efdef24164c8e955bdf1f4c7fd8d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/7a2efdef24164c8e955bdf1f4c7fd8d6/images/large/1.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 376c43d4-682d-5495-8d55-8f0954c5fa9d
2026-01-28 20:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 376c43d4-682d-5495-8d55-8f0954c5fa9d, skipping ID generation
2026-01-28 20:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 376c43d4-682d-5495-8d55-8f0954c5fa9d with scrape type 1
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 376c43d4-682d-5495-8d55-8f0954c5fa9d from tracking dictionaries
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 376c43d4-682d-5495-8d55-8f0954c5fa9d sending to next pipeline
2026-01-28 20:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 376c43d4-682d-5495-8d55-8f0954c5fa9d, identifier: 1878447
2026-01-28 20:02:28 [ayvens.es] INFO: Found listing with ID: 1878455
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878455%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [ayvens.es] INFO: Scrape type for 1878455: 1
2026-01-28 20:02:28 [ayvens.es] INFO: Extracting data for car ID: 1878455
2026-01-28 20:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a7191b7-8838-58c8-ba32-d59b5b33274c with identifier: 1878455
2026-01-28 20:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7191b7-8838-58c8-ba32-d59b5b33274c with scrape type 1
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3a7191b7-8838-58c8-ba32-d59b5b33274c
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252F13941cef71a049c7b57f295d11a7008e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/13941cef71a049c7b57f295d11a7008e/images/large/1.jpg not downloaded yet
2026-01-28 20:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 376c43d4-682d-5495-8d55-8f0954c5fa9d with identifier: 1878447
2026-01-28 20:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 376c43d4-682d-5495-8d55-8f0954c5fa9d with identifier: 1878447
2026-01-28 20:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 376c43d4-682d-5495-8d55-8f0954c5fa9d with identifier: 1878447 to the API
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/449/7a2efdef24164c8e955bdf1f4c7fd8d6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '376c43d4-682d-5495-8d55-8f0954c5fa9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 82691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_376c43d4-682d-5495-8d55-8f0954c5fa9d/376c43d4-682d-5495-8d55-8f0954c5fa9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/449/7a2efdef24164c8e955bdf1f4c7fd8d6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878447%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [ayvens.es] INFO: Saving data for 1878447: {'created_time': 1769630549.235706, 'last_price_update_time': 1769630549.235716, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878447') HTTP/1.1" 204 0
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/676/d3a64b26081c4a80b159f2d9b68c02dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/088/bab9c1ffb7e94eef8ba6026bf50ad06e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [ayvens.es] INFO: Found listing with ID: 1878456
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878456%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [ayvens.es] INFO: Scrape type for 1878456: 1
2026-01-28 20:02:29 [ayvens.es] INFO: Extracting data for car ID: 1878456
2026-01-28 20:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 with identifier: 1878456
2026-01-28 20:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 with scrape type 1
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F960%252Fb5383fcfc41a47048a0f1e1e90e26bbc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/960/b5383fcfc41a47048a0f1e1e90e26bbc/images/large/1.jpg not downloaded yet
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9159bd0>
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49bb2ede-2f9b-591d-83d6-f891776bcf44/49bb2ede-2f9b-591d-83d6-f891776bcf44_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F8e8b67469612482c9c1906ebe65b76ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/8e8b67469612482c9c1906ebe65b76ec/images/large/1.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49bb2ede-2f9b-591d-83d6-f891776bcf44
2026-01-28 20:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49bb2ede-2f9b-591d-83d6-f891776bcf44, skipping ID generation
2026-01-28 20:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49bb2ede-2f9b-591d-83d6-f891776bcf44 with scrape type 1
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 49bb2ede-2f9b-591d-83d6-f891776bcf44 from tracking dictionaries
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49bb2ede-2f9b-591d-83d6-f891776bcf44 sending to next pipeline
2026-01-28 20:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49bb2ede-2f9b-591d-83d6-f891776bcf44, identifier: 1878448
2026-01-28 20:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49bb2ede-2f9b-591d-83d6-f891776bcf44 with identifier: 1878448
2026-01-28 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49bb2ede-2f9b-591d-83d6-f891776bcf44 with identifier: 1878448
2026-01-28 20:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49bb2ede-2f9b-591d-83d6-f891776bcf44 with identifier: 1878448 to the API
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/482/8e8b67469612482c9c1906ebe65b76ec/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '49bb2ede-2f9b-591d-83d6-f891776bcf44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 69364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bb2ede-2f9b-591d-83d6-f891776bcf44/49bb2ede-2f9b-591d-83d6-f891776bcf44_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/482/8e8b67469612482c9c1906ebe65b76ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 81 kW (110 CV) N-CONNECTA',
 'transmission': 'manual',
 'trim': 'dCi 81 kW (110 CV) N-CONNECTA',
 'vin': None,
 'year': 2018}
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878448%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [ayvens.es] INFO: Saving data for 1878448: {'created_time': 1769630550.087391, 'last_price_update_time': 1769630550.087401, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878448') HTTP/1.1" 204 0
2026-01-28 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/408/1adebd7f1d554acba07c3f344bb68c74/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:30 [ayvens.es] INFO: Found listing with ID: 1878457
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878457%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [ayvens.es] INFO: Scrape type for 1878457: 1
2026-01-28 20:02:30 [ayvens.es] INFO: Extracting data for car ID: 1878457
2026-01-28 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3de646b-9acc-511d-89e1-95d059f562a4 with identifier: 1878457
2026-01-28 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3de646b-9acc-511d-89e1-95d059f562a4 with scrape type 1
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f3de646b-9acc-511d-89e1-95d059f562a4
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F044%252Ff88a388e064549e7932b23f306a78267%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/044/f88a388e064549e7932b23f306a78267/images/large/1.jpg not downloaded yet
2026-01-28 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca5f1710>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c/7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F676%252Fd3a64b26081c4a80b159f2d9b68c02dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/676/d3a64b26081c4a80b159f2d9b68c02dd/images/large/1.jpg saved to cache
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c
2026-01-28 20:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c, skipping ID generation
2026-01-28 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c with scrape type 1
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c from tracking dictionaries
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c sending to next pipeline
2026-01-28 20:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c, identifier: 1878449
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca65c650>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84acb2f9-3122-590b-b25c-8c9557d2fee1/84acb2f9-3122-590b-b25c-8c9557d2fee1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252Fbab9c1ffb7e94eef8ba6026bf50ad06e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/bab9c1ffb7e94eef8ba6026bf50ad06e/images/large/1.jpg saved to cache
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84acb2f9-3122-590b-b25c-8c9557d2fee1
2026-01-28 20:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84acb2f9-3122-590b-b25c-8c9557d2fee1, skipping ID generation
2026-01-28 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84acb2f9-3122-590b-b25c-8c9557d2fee1 with scrape type 1
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 84acb2f9-3122-590b-b25c-8c9557d2fee1 from tracking dictionaries
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84acb2f9-3122-590b-b25c-8c9557d2fee1 sending to next pipeline
2026-01-28 20:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84acb2f9-3122-590b-b25c-8c9557d2fee1, identifier: 1878450
2026-01-28 20:02:30 [ayvens.es] INFO: Found listing with ID: 1878458
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878458%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [ayvens.es] INFO: Scrape type for 1878458: 1
2026-01-28 20:02:30 [ayvens.es] INFO: Extracting data for car ID: 1878458
2026-01-28 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 with identifier: 1878458
2026-01-28 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 with scrape type 1
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cdef4255-8b6c-5578-bd63-2ca06ebdd2d3
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F173%252Fadb7deee24d944a68c9007b56f969c06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/173/adb7deee24d944a68c9007b56f969c06/images/large/1.jpg not downloaded yet
2026-01-28 20:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c with identifier: 1878449
2026-01-28 20:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c with identifier: 1878449
2026-01-28 20:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c with identifier: 1878449 to the API
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/676/d3a64b26081c4a80b159f2d9b68c02dd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 77521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c/7bc3d4d4-3436-5a2b-bebd-6a5a5a42763c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/676/d3a64b26081c4a80b159f2d9b68c02dd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878449%27 HTTP/1.1" 200 None
2026-01-28 20:02:31 [ayvens.es] INFO: Saving data for 1878449: {'created_time': 1769630551.62767, 'last_price_update_time': 1769630551.627681, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878449') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84acb2f9-3122-590b-b25c-8c9557d2fee1 with identifier: 1878450
2026-01-28 20:02:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84acb2f9-3122-590b-b25c-8c9557d2fee1 with identifier: 1878450
2026-01-28 20:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84acb2f9-3122-590b-b25c-8c9557d2fee1 with identifier: 1878450 to the API
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/088/bab9c1ffb7e94eef8ba6026bf50ad06e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Perennial',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '84acb2f9-3122-590b-b25c-8c9557d2fee1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 87562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84acb2f9-3122-590b-b25c-8c9557d2fee1/84acb2f9-3122-590b-b25c-8c9557d2fee1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/088/bab9c1ffb7e94eef8ba6026bf50ad06e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW MHEV iMT Drive Plus',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW MHEV iMT Drive Plus',
 'vin': None,
 'year': 2022}
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878450%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [ayvens.es] INFO: Saving data for 1878450: {'created_time': 1769630552.177122, 'last_price_update_time': 1769630552.177132, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878450') HTTP/1.1" 204 0
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:32 [ayvens.es] INFO: Found listing with ID: 1878459
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878459%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [ayvens.es] INFO: Scrape type for 1878459: 1
2026-01-28 20:02:32 [ayvens.es] INFO: Extracting data for car ID: 1878459
2026-01-28 20:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05e526d0-551d-56d5-8114-b09e9207ca84 with identifier: 1878459
2026-01-28 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05e526d0-551d-56d5-8114-b09e9207ca84 with scrape type 1
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 05e526d0-551d-56d5-8114-b09e9207ca84
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252F3285567d70fc4082b24e29c099dc77c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/3285567d70fc4082b24e29c099dc77c5/images/large/1.jpg not downloaded yet
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/169/49ea4c18122446fdb55a7a69a28357e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91458d0>
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7788e781-be6c-5620-9e76-0e3bdfdd1a3c/7788e781-be6c-5620-9e76-0e3bdfdd1a3c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F408%252F1adebd7f1d554acba07c3f344bb68c74%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/408/1adebd7f1d554acba07c3f344bb68c74/images/large/1.jpg saved to cache
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7788e781-be6c-5620-9e76-0e3bdfdd1a3c
2026-01-28 20:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7788e781-be6c-5620-9e76-0e3bdfdd1a3c, skipping ID generation
2026-01-28 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7788e781-be6c-5620-9e76-0e3bdfdd1a3c with scrape type 1
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7788e781-be6c-5620-9e76-0e3bdfdd1a3c from tracking dictionaries
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7788e781-be6c-5620-9e76-0e3bdfdd1a3c sending to next pipeline
2026-01-28 20:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7788e781-be6c-5620-9e76-0e3bdfdd1a3c, identifier: 1878451
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca88e290>
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c9a5d3-29af-5123-af4c-0470a7330915/94c9a5d3-29af-5123-af4c-0470a7330915_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F767%252Fc2945db9689e491e8227b41f0defba38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg saved to cache
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94c9a5d3-29af-5123-af4c-0470a7330915
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94c9a5d3-29af-5123-af4c-0470a7330915, skipping ID generation
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c9a5d3-29af-5123-af4c-0470a7330915 with scrape type 1
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 94c9a5d3-29af-5123-af4c-0470a7330915 from tracking dictionaries
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94c9a5d3-29af-5123-af4c-0470a7330915 sending to next pipeline
2026-01-28 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94c9a5d3-29af-5123-af4c-0470a7330915, identifier: 1878452
2026-01-28 20:02:33 [ayvens.es] INFO: Found listing with ID: 1878460
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878460%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [ayvens.es] INFO: Scrape type for 1878460: 1
2026-01-28 20:02:33 [ayvens.es] INFO: Extracting data for car ID: 1878460
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88640e8-a267-5271-9426-ae919a422e0f with identifier: 1878460
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88640e8-a267-5271-9426-ae919a422e0f with scrape type 1
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c88640e8-a267-5271-9426-ae919a422e0f
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Fdcf42ee627d24c5eb45d51bc3791c097%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/dcf42ee627d24c5eb45d51bc3791c097/images/large/1.jpg not downloaded yet
2026-01-28 20:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7788e781-be6c-5620-9e76-0e3bdfdd1a3c with identifier: 1878451
2026-01-28 20:02:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7788e781-be6c-5620-9e76-0e3bdfdd1a3c with identifier: 1878451
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7788e781-be6c-5620-9e76-0e3bdfdd1a3c spider: ayvens.es
2026-01-28 20:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7788e781-be6c-5620-9e76-0e3bdfdd1a3c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7788e781-be6c-5620-9e76-0e3bdfdd1a3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 68734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7788e781-be6c-5620-9e76-0e3bdfdd1a3c/7788e781-be6c-5620-9e76-0e3bdfdd1a3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/408/1adebd7f1d554acba07c3f344bb68c74/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 100 S&S 6v Control',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S 6v Control',
 'vin': None,
 'year': 2022}
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878451%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [ayvens.es] INFO: Saving data for 1878451: {'created_time': 1769630553.442693, 'last_price_update_time': 1769630553.442705, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878451') HTTP/1.1" 204 0
2026-01-28 20:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94c9a5d3-29af-5123-af4c-0470a7330915 with identifier: 1878452
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94c9a5d3-29af-5123-af4c-0470a7330915 with identifier: 1878452
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'pintura', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'express', 'trim': 'confort 1.5 blue dci 55 kw (75 cv)', 'title': 'renault express confort 1.5 blue dci 55 kw (75 cv)', 'price': 0, 'odometer': 218664, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-26', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 133, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '94c9a5d3-29af-5123-af4c-0470a7330915', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c9a5d3-29af-5123-af4c-0470a7330915/94c9a5d3-29af-5123-af4c-0470a7330915_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 332884}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'renault express', 'sanitized_make': 'renault', 'odometer_in_km': 218664}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 133,
     'color': 'pintura',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '94c9a5d3-29af-5123-af4c-0470a7330915',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault express',
     'model': 'express',
     'odometer': 218664,
     'odometer_in_km': 218664,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c9a5d3-29af-5123-af4c-0470a7330915/94c9a5d3-29af-5123-af4c-0470a7330915_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 332884,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-26',
     'sanitized_make': 'renault',
     'seats_number': 2,
     'seller_name': None,
     'title': 'renault express confort 1.5 blue dci 55 kw (75 cv)',
     'transmission': 'manual',
     'trim': 'confort 1.5 blue dci 55 kw (75 cv)',
     'vin': None,
     'year': 2021}
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 94c9a5d3-29af-5123-af4c-0470a7330915 spider: ayvens.es
2026-01-28 20:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 94c9a5d3-29af-5123-af4c-0470a7330915 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'pintura', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'express', 'trim': 'confort 1.5 blue dci 55 kw (75 cv)', 'title': 'renault express confort 1.5 blue dci 55 kw (75 cv)', 'price': 0, 'odometer': 218664, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-26', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 133, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '94c9a5d3-29af-5123-af4c-0470a7330915', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c9a5d3-29af-5123-af4c-0470a7330915/94c9a5d3-29af-5123-af4c-0470a7330915_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 332884}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'renault express', 'sanitized_make': 'renault', 'odometer_in_km': 218664}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 133,
     'color': 'pintura',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '94c9a5d3-29af-5123-af4c-0470a7330915',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault express',
     'model': 'express',
     'odometer': 218664,
     'odometer_in_km': 218664,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c9a5d3-29af-5123-af4c-0470a7330915/94c9a5d3-29af-5123-af4c-0470a7330915_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 332884,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-26',
     'sanitized_make': 'renault',
     'seats_number': 2,
     'seller_name': None,
     'title': 'renault express confort 1.5 blue dci 55 kw (75 cv)',
     'transmission': 'manual',
     'trim': 'confort 1.5 blue dci 55 kw (75 cv)',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '94c9a5d3-29af-5123-af4c-0470a7330915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 218664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c9a5d3-29af-5123-af4c-0470a7330915/94c9a5d3-29af-5123-af4c-0470a7330915_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/767/c2945db9689e491e8227b41f0defba38/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878452%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [ayvens.es] INFO: Saving data for 1878452: {'created_time': 1769630553.795501, 'last_price_update_time': 1769630553.795511, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878452') HTTP/1.1" 204 0
2026-01-28 20:02:33 [ayvens.es] INFO: Found listing with ID: 1878461
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878461%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [ayvens.es] INFO: Scrape type for 1878461: 1
2026-01-28 20:02:33 [ayvens.es] INFO: Extracting data for car ID: 1878461
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62503faf-b69f-522a-a1e2-e91d6ed0b7ff with identifier: 1878461
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62503faf-b69f-522a-a1e2-e91d6ed0b7ff with scrape type 1
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62503faf-b69f-522a-a1e2-e91d6ed0b7ff
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F1def551fd4444e0a8f00a1f2b421314e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/1def551fd4444e0a8f00a1f2b421314e/images/large/1.jpg not downloaded yet
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9161fd0>
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252F94b54ebed98e4d6c850ce5fac2105a4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg saved to cache
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fecb344-051e-5564-b6f8-b0a94ab07fca
2026-01-28 20:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fecb344-051e-5564-b6f8-b0a94ab07fca, skipping ID generation
2026-01-28 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fecb344-051e-5564-b6f8-b0a94ab07fca with scrape type 1
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6fecb344-051e-5564-b6f8-b0a94ab07fca from tracking dictionaries
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fecb344-051e-5564-b6f8-b0a94ab07fca sending to next pipeline
2026-01-28 20:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6fecb344-051e-5564-b6f8-b0a94ab07fca, identifier: 1878454
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ccb3d3d0>
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_043e313e-ec19-5cb7-8e54-0a459a1f9bcc/043e313e-ec19-5cb7-8e54-0a459a1f9bcc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F169%252F49ea4c18122446fdb55a7a69a28357e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/169/49ea4c18122446fdb55a7a69a28357e2/images/large/1.jpg saved to cache
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 043e313e-ec19-5cb7-8e54-0a459a1f9bcc
2026-01-28 20:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 043e313e-ec19-5cb7-8e54-0a459a1f9bcc, skipping ID generation
2026-01-28 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043e313e-ec19-5cb7-8e54-0a459a1f9bcc with scrape type 1
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 043e313e-ec19-5cb7-8e54-0a459a1f9bcc from tracking dictionaries
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 043e313e-ec19-5cb7-8e54-0a459a1f9bcc sending to next pipeline
2026-01-28 20:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 043e313e-ec19-5cb7-8e54-0a459a1f9bcc, identifier: 1878453
2026-01-28 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/960/b5383fcfc41a47048a0f1e1e90e26bbc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:34 [ayvens.es] INFO: Found listing with ID: 1878462
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878462%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [ayvens.es] INFO: Scrape type for 1878462: 1
2026-01-28 20:02:34 [ayvens.es] INFO: Extracting data for car ID: 1878462
2026-01-28 20:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a0051a9-2fa2-5509-b5e3-9087c578ed9d with identifier: 1878462
2026-01-28 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0051a9-2fa2-5509-b5e3-9087c578ed9d with scrape type 1
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4a0051a9-2fa2-5509-b5e3-9087c578ed9d
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F312%252F5d6ab9fe75974ebfaa95102c5129edfb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/312/5d6ab9fe75974ebfaa95102c5129edfb/images/large/1.jpg not downloaded yet
2026-01-28 20:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6fecb344-051e-5564-b6f8-b0a94ab07fca with identifier: 1878454
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6fecb344-051e-5564-b6f8-b0a94ab07fca with identifier: 1878454
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo express', 'trim': 'profesional blue dci 70kw (95cv)', 'title': 'renault kangoo express profesional blue dci 70kw (95cv)', 'price': 0, 'odometer': 211757, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-04', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 3, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 112, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6fecb344-051e-5564-b6f8-b0a94ab07fca', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 310130}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'renault kangoo express', 'sanitized_make': 'renault', 'odometer_in_km': 211757}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 3,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '6fecb344-051e-5564-b6f8-b0a94ab07fca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo express',
     'model': 'kangoo express',
     'odometer': 211757,
     'odometer_in_km': 211757,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 310130,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-04',
     'sanitized_make': 'renault',
     'seats_number': 2,
     'seller_name': None,
     'title': 'renault kangoo express profesional blue dci 70kw (95cv)',
     'transmission': 'manual',
     'trim': 'profesional blue dci 70kw (95cv)',
     'vin': None,
     'year': 2020}
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 6fecb344-051e-5564-b6f8-b0a94ab07fca spider: ayvens.es
2026-01-28 20:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6fecb344-051e-5564-b6f8-b0a94ab07fca due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo express', 'trim': 'profesional blue dci 70kw (95cv)', 'title': 'renault kangoo express profesional blue dci 70kw (95cv)', 'price': 0, 'odometer': 211757, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-04', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 3, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 112, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6fecb344-051e-5564-b6f8-b0a94ab07fca', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 310130}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'renault kangoo express', 'sanitized_make': 'renault', 'odometer_in_km': 211757}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 3,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '6fecb344-051e-5564-b6f8-b0a94ab07fca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo express',
     'model': 'kangoo express',
     'odometer': 211757,
     'odometer_in_km': 211757,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 310130,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-04',
     'sanitized_make': 'renault',
     'seats_number': 2,
     'seller_name': None,
     'title': 'renault kangoo express profesional blue dci 70kw (95cv)',
     'transmission': 'manual',
     'trim': 'profesional blue dci 70kw (95cv)',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6fecb344-051e-5564-b6f8-b0a94ab07fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 211757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/94b54ebed98e4d6c850ce5fac2105a4d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878454%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [ayvens.es] INFO: Saving data for 1878454: {'created_time': 1769630554.922954, 'last_price_update_time': 1769630554.922968, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878454') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 043e313e-ec19-5cb7-8e54-0a459a1f9bcc with identifier: 1878453
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 043e313e-ec19-5cb7-8e54-0a459a1f9bcc with identifier: 1878453
2026-01-28 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 043e313e-ec19-5cb7-8e54-0a459a1f9bcc spider: ayvens.es
2026-01-28 20:02:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 043e313e-ec19-5cb7-8e54-0a459a1f9bcc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '043e313e-ec19-5cb7-8e54-0a459a1f9bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 71913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_043e313e-ec19-5cb7-8e54-0a459a1f9bcc/043e313e-ec19-5cb7-8e54-0a459a1f9bcc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/169/49ea4c18122446fdb55a7a69a28357e2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878453%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [ayvens.es] INFO: Saving data for 1878453: {'created_time': 1769630555.188115, 'last_price_update_time': 1769630555.18813, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878453') HTTP/1.1" 204 0
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/766/13941cef71a049c7b57f295d11a7008e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [ayvens.es] INFO: Found listing with ID: 1878463
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878463%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [ayvens.es] INFO: Scrape type for 1878463: 1
2026-01-28 20:02:35 [ayvens.es] INFO: Extracting data for car ID: 1878463
2026-01-28 20:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8622899a-c074-5d54-b43e-826f4c6ae231 with identifier: 1878463
2026-01-28 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8622899a-c074-5d54-b43e-826f4c6ae231 with scrape type 1
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8622899a-c074-5d54-b43e-826f4c6ae231
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252F3fd263178e3c43689bca674355da031f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/3fd263178e3c43689bca674355da031f/images/large/1.jpg not downloaded yet
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/173/adb7deee24d944a68c9007b56f969c06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8feb290>
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42/0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F960%252Fb5383fcfc41a47048a0f1e1e90e26bbc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/960/b5383fcfc41a47048a0f1e1e90e26bbc/images/large/1.jpg saved to cache
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42
2026-01-28 20:02:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42, skipping ID generation
2026-01-28 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 with scrape type 1
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 from tracking dictionaries
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 sending to next pipeline
2026-01-28 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42, identifier: 1878456
2026-01-28 20:02:35 [ayvens.es] INFO: Found listing with ID: 1878464
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878464%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [ayvens.es] INFO: Scrape type for 1878464: 1
2026-01-28 20:02:35 [ayvens.es] INFO: Extracting data for car ID: 1878464
2026-01-28 20:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c9280f-80a2-5a9f-8ff4-62992a506ece with identifier: 1878464
2026-01-28 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c9280f-80a2-5a9f-8ff4-62992a506ece with scrape type 1
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8c9280f-80a2-5a9f-8ff4-62992a506ece
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Ff9db14e7de8d46c59fc4c8d640cf82e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/f9db14e7de8d46c59fc4c8d640cf82e1/images/large/1.jpg not downloaded yet
2026-01-28 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 with identifier: 1878456
2026-01-28 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 with identifier: 1878456
2026-01-28 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-28 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 spider: ayvens.es
2026-01-28 20:02:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 100995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42/0f3d3aa3-ef58-56f1-a22b-c2d4d7d3fe42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/960/b5383fcfc41a47048a0f1e1e90e26bbc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878456%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [ayvens.es] INFO: Saving data for 1878456: {'created_time': 1769630555.966831, 'last_price_update_time': 1769630555.966844, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878456') HTTP/1.1" 204 0
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/044/f88a388e064549e7932b23f306a78267/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/613/3285567d70fc4082b24e29c099dc77c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [ayvens.es] INFO: Found listing with ID: 1878465
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878465%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [ayvens.es] INFO: Scrape type for 1878465: 1
2026-01-28 20:02:36 [ayvens.es] INFO: Extracting data for car ID: 1878465
2026-01-28 20:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 with identifier: 1878465
2026-01-28 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 with scrape type 1
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8dbc5038-f88e-5068-b4e2-97fe4eb2e107
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F095%252F001ddc72beeb44baa73ab049c3469bc0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/095/001ddc72beeb44baa73ab049c3469bc0/images/large/1.jpg not downloaded yet
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81cc927ad0>
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a7191b7-8838-58c8-ba32-d59b5b33274c/3a7191b7-8838-58c8-ba32-d59b5b33274c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252F13941cef71a049c7b57f295d11a7008e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/13941cef71a049c7b57f295d11a7008e/images/large/1.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a7191b7-8838-58c8-ba32-d59b5b33274c
2026-01-28 20:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a7191b7-8838-58c8-ba32-d59b5b33274c, skipping ID generation
2026-01-28 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7191b7-8838-58c8-ba32-d59b5b33274c with scrape type 1
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a7191b7-8838-58c8-ba32-d59b5b33274c from tracking dictionaries
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a7191b7-8838-58c8-ba32-d59b5b33274c sending to next pipeline
2026-01-28 20:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3a7191b7-8838-58c8-ba32-d59b5b33274c, identifier: 1878455
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fc5ed0>
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdef4255-8b6c-5578-bd63-2ca06ebdd2d3/cdef4255-8b6c-5578-bd63-2ca06ebdd2d3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F173%252Fadb7deee24d944a68c9007b56f969c06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/173/adb7deee24d944a68c9007b56f969c06/images/large/1.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdef4255-8b6c-5578-bd63-2ca06ebdd2d3
2026-01-28 20:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdef4255-8b6c-5578-bd63-2ca06ebdd2d3, skipping ID generation
2026-01-28 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 with scrape type 1
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 from tracking dictionaries
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 sending to next pipeline
2026-01-28 20:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cdef4255-8b6c-5578-bd63-2ca06ebdd2d3, identifier: 1878458
2026-01-28 20:02:37 [ayvens.es] INFO: Found listing with ID: 1878466
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878466%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [ayvens.es] INFO: Scrape type for 1878466: 1
2026-01-28 20:02:37 [ayvens.es] INFO: Extracting data for car ID: 1878466
2026-01-28 20:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc94a84-3d83-52f2-8b73-704a1661d730 with identifier: 1878466
2026-01-28 20:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc94a84-3d83-52f2-8b73-704a1661d730 with scrape type 1
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0fc94a84-3d83-52f2-8b73-704a1661d730
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F001%252F527fcf659e83430c8a918984c3a76b0b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/001/527fcf659e83430c8a918984c3a76b0b/images/large/1.jpg not downloaded yet
2026-01-28 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3a7191b7-8838-58c8-ba32-d59b5b33274c with identifier: 1878455
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3a7191b7-8838-58c8-ba32-d59b5b33274c with identifier: 1878455
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184980 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184980
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3a7191b7-8838-58c8-ba32-d59b5b33274c spider: ayvens.es
2026-01-28 20:02:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 3a7191b7-8838-58c8-ba32-d59b5b33274c due to rule: high_mileage_for_country.json, error: 184980 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184980
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a7191b7-8838-58c8-ba32-d59b5b33274c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 184980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a7191b7-8838-58c8-ba32-d59b5b33274c/3a7191b7-8838-58c8-ba32-d59b5b33274c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/766/13941cef71a049c7b57f295d11a7008e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 GT BlueHDI 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'GT BlueHDI 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878455%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [ayvens.es] INFO: Saving data for 1878455: {'created_time': 1769630557.40593, 'last_price_update_time': 1769630557.405943, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878455') HTTP/1.1" 204 0
2026-01-28 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 with identifier: 1878458
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 with identifier: 1878458
2026-01-28 20:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cdef4255-8b6c-5578-bd63-2ca06ebdd2d3 with identifier: 1878458 to the API
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/173/adb7deee24d944a68c9007b56f969c06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cdef4255-8b6c-5578-bd63-2ca06ebdd2d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 104655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdef4255-8b6c-5578-bd63-2ca06ebdd2d3/cdef4255-8b6c-5578-bd63-2ca06ebdd2d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/173/adb7deee24d944a68c9007b56f969c06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 D4 AWD Momentum Auto',
 'transmission': 'manual',
 'trim': '2.0 D4 AWD Momentum Auto',
 'vin': None,
 'year': 2018}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878458%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [ayvens.es] INFO: Saving data for 1878458: {'created_time': 1769630557.898637, 'last_price_update_time': 1769630557.898648, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878458') HTTP/1.1" 204 0
2026-01-28 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/469/dcf42ee627d24c5eb45d51bc3791c097/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:37 [ayvens.es] INFO: Found listing with ID: 1878467
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878467%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [ayvens.es] INFO: Scrape type for 1878467: 1
2026-01-28 20:02:37 [ayvens.es] INFO: Extracting data for car ID: 1878467
2026-01-28 20:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5e759c3-aa3b-5f7b-bf4c-3be561d204dc with identifier: 1878467
2026-01-28 20:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e759c3-aa3b-5f7b-bf4c-3be561d204dc with scrape type 1
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5e759c3-aa3b-5f7b-bf4c-3be561d204dc
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252F525320d9b5f2448f8d2d3389156ecd79%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/525320d9b5f2448f8d2d3389156ecd79/images/large/1.jpg not downloaded yet
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1fd4d0>
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3de646b-9acc-511d-89e1-95d059f562a4/f3de646b-9acc-511d-89e1-95d059f562a4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F044%252Ff88a388e064549e7932b23f306a78267%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/044/f88a388e064549e7932b23f306a78267/images/large/1.jpg saved to cache
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3de646b-9acc-511d-89e1-95d059f562a4
2026-01-28 20:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3de646b-9acc-511d-89e1-95d059f562a4, skipping ID generation
2026-01-28 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3de646b-9acc-511d-89e1-95d059f562a4 with scrape type 1
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f3de646b-9acc-511d-89e1-95d059f562a4 from tracking dictionaries
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3de646b-9acc-511d-89e1-95d059f562a4 sending to next pipeline
2026-01-28 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f3de646b-9acc-511d-89e1-95d059f562a4, identifier: 1878457
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca299090>
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05e526d0-551d-56d5-8114-b09e9207ca84/05e526d0-551d-56d5-8114-b09e9207ca84_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252F3285567d70fc4082b24e29c099dc77c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/3285567d70fc4082b24e29c099dc77c5/images/large/1.jpg saved to cache
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05e526d0-551d-56d5-8114-b09e9207ca84
2026-01-28 20:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05e526d0-551d-56d5-8114-b09e9207ca84, skipping ID generation
2026-01-28 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05e526d0-551d-56d5-8114-b09e9207ca84 with scrape type 1
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 05e526d0-551d-56d5-8114-b09e9207ca84 from tracking dictionaries
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05e526d0-551d-56d5-8114-b09e9207ca84 sending to next pipeline
2026-01-28 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 05e526d0-551d-56d5-8114-b09e9207ca84, identifier: 1878459
2026-01-28 20:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f3de646b-9acc-511d-89e1-95d059f562a4 with identifier: 1878457
2026-01-28 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f3de646b-9acc-511d-89e1-95d059f562a4 with identifier: 1878457
2026-01-28 20:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f3de646b-9acc-511d-89e1-95d059f562a4 with identifier: 1878457 to the API
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/044/f88a388e064549e7932b23f306a78267/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f3de646b-9acc-511d-89e1-95d059f562a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 128555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3de646b-9acc-511d-89e1-95d059f562a4/f3de646b-9acc-511d-89e1-95d059f562a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/044/f88a388e064549e7932b23f306a78267/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S Allure Pack EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S Allure Pack EAT8',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878457%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [ayvens.es] INFO: Saving data for 1878457: {'created_time': 1769630559.453099, 'last_price_update_time': 1769630559.453109, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878457') HTTP/1.1" 204 0
2026-01-28 20:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 05e526d0-551d-56d5-8114-b09e9207ca84 with identifier: 1878459
2026-01-28 20:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 05e526d0-551d-56d5-8114-b09e9207ca84 with identifier: 1878459
2026-01-28 20:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
2026-01-28 20:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 05e526d0-551d-56d5-8114-b09e9207ca84 spider: ayvens.es
2026-01-28 20:02:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 05e526d0-551d-56d5-8114-b09e9207ca84 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '05e526d0-551d-56d5-8114-b09e9207ca84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 143425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e526d0-551d-56d5-8114-b09e9207ca84/05e526d0-551d-56d5-8114-b09e9207ca84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/613/3285567d70fc4082b24e29c099dc77c5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878459%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [ayvens.es] INFO: Saving data for 1878459: {'created_time': 1769630559.68237, 'last_price_update_time': 1769630559.68238, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878459') HTTP/1.1" 204 0
2026-01-28 20:02:39 [ayvens.es] INFO: Found listing with ID: 1878468
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878468%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [ayvens.es] INFO: Scrape type for 1878468: 1
2026-01-28 20:02:39 [ayvens.es] INFO: Extracting data for car ID: 1878468
2026-01-28 20:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 with identifier: 1878468
2026-01-28 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 with scrape type 1
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6918de53-6e25-5b75-b9fc-88eb8bd4ef62
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F711%252F13b6055f2196465f9ccdb85b985b020c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/711/13b6055f2196465f9ccdb85b985b020c/images/large/1.jpg not downloaded yet
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/153/1def551fd4444e0a8f00a1f2b421314e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1f3610>
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88640e8-a267-5271-9426-ae919a422e0f/c88640e8-a267-5271-9426-ae919a422e0f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Fdcf42ee627d24c5eb45d51bc3791c097%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/dcf42ee627d24c5eb45d51bc3791c097/images/large/1.jpg saved to cache
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c88640e8-a267-5271-9426-ae919a422e0f
2026-01-28 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c88640e8-a267-5271-9426-ae919a422e0f, skipping ID generation
2026-01-28 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88640e8-a267-5271-9426-ae919a422e0f with scrape type 1
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c88640e8-a267-5271-9426-ae919a422e0f from tracking dictionaries
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c88640e8-a267-5271-9426-ae919a422e0f sending to next pipeline
2026-01-28 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c88640e8-a267-5271-9426-ae919a422e0f, identifier: 1878460
2026-01-28 20:02:40 [ayvens.es] INFO: Found listing with ID: 1878469
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878469%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [ayvens.es] INFO: Scrape type for 1878469: 1
2026-01-28 20:02:40 [ayvens.es] INFO: Extracting data for car ID: 1878469
2026-01-28 20:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89141db0-4e6d-5c76-a64d-568ee3f2dc90 with identifier: 1878469
2026-01-28 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89141db0-4e6d-5c76-a64d-568ee3f2dc90 with scrape type 1
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89141db0-4e6d-5c76-a64d-568ee3f2dc90
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F031%252F71937cacd5414b83b84e0ebfdec9217d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/031/71937cacd5414b83b84e0ebfdec9217d/images/large/1.jpg not downloaded yet
2026-01-28 20:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c88640e8-a267-5271-9426-ae919a422e0f with identifier: 1878460
2026-01-28 20:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c88640e8-a267-5271-9426-ae919a422e0f with identifier: 1878460
2026-01-28 20:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c88640e8-a267-5271-9426-ae919a422e0f with identifier: 1878460 to the API
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/469/dcf42ee627d24c5eb45d51bc3791c097/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c88640e8-a267-5271-9426-ae919a422e0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 61979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88640e8-a267-5271-9426-ae919a422e0f/c88640e8-a267-5271-9426-ae919a422e0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/469/dcf42ee627d24c5eb45d51bc3791c097/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878460%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [ayvens.es] INFO: Saving data for 1878460: {'created_time': 1769630560.617123, 'last_price_update_time': 1769630560.617137, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878460') HTTP/1.1" 204 0
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/103/3fd263178e3c43689bca674355da031f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:40 [ayvens.es] INFO: Found listing with ID: 1878470
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878470%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [ayvens.es] INFO: Scrape type for 1878470: 1
2026-01-28 20:02:40 [ayvens.es] INFO: Extracting data for car ID: 1878470
2026-01-28 20:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e2961df-e169-5ad5-b70b-9bbb8bd74878 with identifier: 1878470
2026-01-28 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2961df-e169-5ad5-b70b-9bbb8bd74878 with scrape type 1
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e2961df-e169-5ad5-b70b-9bbb8bd74878
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F637%252Fd934979b9ac2476482ff6b7293a8e500%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/637/d934979b9ac2476482ff6b7293a8e500/images/large/1.jpg not downloaded yet
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9158f50>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62503faf-b69f-522a-a1e2-e91d6ed0b7ff/62503faf-b69f-522a-a1e2-e91d6ed0b7ff_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F1def551fd4444e0a8f00a1f2b421314e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/1def551fd4444e0a8f00a1f2b421314e/images/large/1.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62503faf-b69f-522a-a1e2-e91d6ed0b7ff
2026-01-28 20:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62503faf-b69f-522a-a1e2-e91d6ed0b7ff, skipping ID generation
2026-01-28 20:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62503faf-b69f-522a-a1e2-e91d6ed0b7ff with scrape type 1
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 62503faf-b69f-522a-a1e2-e91d6ed0b7ff from tracking dictionaries
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62503faf-b69f-522a-a1e2-e91d6ed0b7ff sending to next pipeline
2026-01-28 20:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62503faf-b69f-522a-a1e2-e91d6ed0b7ff, identifier: 1878461
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/312/5d6ab9fe75974ebfaa95102c5129edfb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:41 [ayvens.es] INFO: Found listing with ID: 1878471
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878471%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [ayvens.es] INFO: Scrape type for 1878471: 1
2026-01-28 20:02:41 [ayvens.es] INFO: Extracting data for car ID: 1878471
2026-01-28 20:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba with identifier: 1878471
2026-01-28 20:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba with scrape type 1
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F51d85820cc47407bb57b0a5b49af1b95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/51d85820cc47407bb57b0a5b49af1b95/images/large/1.jpg not downloaded yet
2026-01-28 20:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62503faf-b69f-522a-a1e2-e91d6ed0b7ff with identifier: 1878461
2026-01-28 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62503faf-b69f-522a-a1e2-e91d6ed0b7ff with identifier: 1878461
2026-01-28 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-28 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 62503faf-b69f-522a-a1e2-e91d6ed0b7ff spider: ayvens.es
2026-01-28 20:02:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 62503faf-b69f-522a-a1e2-e91d6ed0b7ff due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '62503faf-b69f-522a-a1e2-e91d6ed0b7ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 69473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62503faf-b69f-522a-a1e2-e91d6ed0b7ff/62503faf-b69f-522a-a1e2-e91d6ed0b7ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/153/1def551fd4444e0a8f00a1f2b421314e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Kombi 2.0 TDCI 136kW 320 L1 Sport Auto',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 TDCI 136kW 320 L1 Sport Auto',
 'vin': None,
 'year': 2022}
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878461%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [ayvens.es] INFO: Saving data for 1878461: {'created_time': 1769630561.490847, 'last_price_update_time': 1769630561.490857, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878461') HTTP/1.1" 204 0
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/f9db14e7de8d46c59fc4c8d640cf82e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/001/527fcf659e83430c8a918984c3a76b0b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/095/001ddc72beeb44baa73ab049c3469bc0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:41 [ayvens.es] INFO: Found listing with ID: 1878472
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878472%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [ayvens.es] INFO: Scrape type for 1878472: 1
2026-01-28 20:02:41 [ayvens.es] INFO: Extracting data for car ID: 1878472
2026-01-28 20:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1787ca2-e3cd-56e5-890c-797a121014bd with identifier: 1878472
2026-01-28 20:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1787ca2-e3cd-56e5-890c-797a121014bd with scrape type 1
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1787ca2-e3cd-56e5-890c-797a121014bd
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F222%252F8d566f6dc52e4acc89dacef299220280%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/222/8d566f6dc52e4acc89dacef299220280/images/large/1.jpg not downloaded yet
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fd5090>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8622899a-c074-5d54-b43e-826f4c6ae231/8622899a-c074-5d54-b43e-826f4c6ae231_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252F3fd263178e3c43689bca674355da031f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/3fd263178e3c43689bca674355da031f/images/large/1.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8622899a-c074-5d54-b43e-826f4c6ae231
2026-01-28 20:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8622899a-c074-5d54-b43e-826f4c6ae231, skipping ID generation
2026-01-28 20:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8622899a-c074-5d54-b43e-826f4c6ae231 with scrape type 1
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8622899a-c074-5d54-b43e-826f4c6ae231 from tracking dictionaries
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8622899a-c074-5d54-b43e-826f4c6ae231 sending to next pipeline
2026-01-28 20:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8622899a-c074-5d54-b43e-826f4c6ae231, identifier: 1878463
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fd1cd0>
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0051a9-2fa2-5509-b5e3-9087c578ed9d/4a0051a9-2fa2-5509-b5e3-9087c578ed9d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F312%252F5d6ab9fe75974ebfaa95102c5129edfb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/312/5d6ab9fe75974ebfaa95102c5129edfb/images/large/1.jpg saved to cache
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a0051a9-2fa2-5509-b5e3-9087c578ed9d
2026-01-28 20:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a0051a9-2fa2-5509-b5e3-9087c578ed9d, skipping ID generation
2026-01-28 20:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0051a9-2fa2-5509-b5e3-9087c578ed9d with scrape type 1
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4a0051a9-2fa2-5509-b5e3-9087c578ed9d from tracking dictionaries
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a0051a9-2fa2-5509-b5e3-9087c578ed9d sending to next pipeline
2026-01-28 20:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4a0051a9-2fa2-5509-b5e3-9087c578ed9d, identifier: 1878462
2026-01-28 20:02:42 [ayvens.es] INFO: Found listing with ID: 1878473
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878473%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [ayvens.es] INFO: Scrape type for 1878473: 1
2026-01-28 20:02:42 [ayvens.es] INFO: Extracting data for car ID: 1878473
2026-01-28 20:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 with identifier: 1878473
2026-01-28 20:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 with scrape type 1
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F350%252F66426d34debc4fdfa39917e931828b9a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/350/66426d34debc4fdfa39917e931828b9a/images/large/1.jpg not downloaded yet
2026-01-28 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8622899a-c074-5d54-b43e-826f4c6ae231 with identifier: 1878463
2026-01-28 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8622899a-c074-5d54-b43e-826f4c6ae231 with identifier: 1878463
2026-01-28 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2026-01-28 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8622899a-c074-5d54-b43e-826f4c6ae231 spider: ayvens.es
2026-01-28 20:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8622899a-c074-5d54-b43e-826f4c6ae231 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8622899a-c074-5d54-b43e-826f4c6ae231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 108069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8622899a-c074-5d54-b43e-826f4c6ae231/8622899a-c074-5d54-b43e-826f4c6ae231_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/103/3fd263178e3c43689bca674355da031f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Profesional Kombi 2.0 TDI 55kW BMT',
 'transmission': 'manual',
 'trim': 'Profesional Kombi 2.0 TDI 55kW BMT',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878463%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [ayvens.es] INFO: Saving data for 1878463: {'created_time': 1769630562.727984, 'last_price_update_time': 1769630562.727995, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878463') HTTP/1.1" 204 0
2026-01-28 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4a0051a9-2fa2-5509-b5e3-9087c578ed9d with identifier: 1878462
2026-01-28 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4a0051a9-2fa2-5509-b5e3-9087c578ed9d with identifier: 1878462
2026-01-28 20:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4a0051a9-2fa2-5509-b5e3-9087c578ed9d with identifier: 1878462 to the API
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/312/5d6ab9fe75974ebfaa95102c5129edfb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Corporativo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4a0051a9-2fa2-5509-b5e3-9087c578ed9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 121158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0051a9-2fa2-5509-b5e3-9087c578ed9d/4a0051a9-2fa2-5509-b5e3-9087c578ed9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/312/5d6ab9fe75974ebfaa95102c5129edfb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2018}
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878462%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [ayvens.es] INFO: Saving data for 1878462: {'created_time': 1769630563.218515, 'last_price_update_time': 1769630563.218528, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878462') HTTP/1.1" 204 0
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca88cb10>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c9280f-80a2-5a9f-8ff4-62992a506ece/c8c9280f-80a2-5a9f-8ff4-62992a506ece_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Ff9db14e7de8d46c59fc4c8d640cf82e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/f9db14e7de8d46c59fc4c8d640cf82e1/images/large/1.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8c9280f-80a2-5a9f-8ff4-62992a506ece
2026-01-28 20:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8c9280f-80a2-5a9f-8ff4-62992a506ece, skipping ID generation
2026-01-28 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c9280f-80a2-5a9f-8ff4-62992a506ece with scrape type 1
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c8c9280f-80a2-5a9f-8ff4-62992a506ece from tracking dictionaries
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8c9280f-80a2-5a9f-8ff4-62992a506ece sending to next pipeline
2026-01-28 20:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8c9280f-80a2-5a9f-8ff4-62992a506ece, identifier: 1878464
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91361d0>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc94a84-3d83-52f2-8b73-704a1661d730/0fc94a84-3d83-52f2-8b73-704a1661d730_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F001%252F527fcf659e83430c8a918984c3a76b0b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/001/527fcf659e83430c8a918984c3a76b0b/images/large/1.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fc94a84-3d83-52f2-8b73-704a1661d730
2026-01-28 20:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fc94a84-3d83-52f2-8b73-704a1661d730, skipping ID generation
2026-01-28 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc94a84-3d83-52f2-8b73-704a1661d730 with scrape type 1
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0fc94a84-3d83-52f2-8b73-704a1661d730 from tracking dictionaries
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fc94a84-3d83-52f2-8b73-704a1661d730 sending to next pipeline
2026-01-28 20:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0fc94a84-3d83-52f2-8b73-704a1661d730, identifier: 1878466
2026-01-28 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/711/13b6055f2196465f9ccdb85b985b020c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:44 [ayvens.es] INFO: Found listing with ID: 1878474
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878474%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [ayvens.es] INFO: Scrape type for 1878474: 1
2026-01-28 20:02:44 [ayvens.es] INFO: Extracting data for car ID: 1878474
2026-01-28 20:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b7e0087-366c-536e-8e4d-72ecec9fa93e with identifier: 1878474
2026-01-28 20:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b7e0087-366c-536e-8e4d-72ecec9fa93e with scrape type 1
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4b7e0087-366c-536e-8e4d-72ecec9fa93e
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F556%252F80407aa4dd9b4bf49868d2505fc601d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/556/80407aa4dd9b4bf49868d2505fc601d9/images/large/1.jpg not downloaded yet
2026-01-28 20:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8c9280f-80a2-5a9f-8ff4-62992a506ece with identifier: 1878464
2026-01-28 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8c9280f-80a2-5a9f-8ff4-62992a506ece with identifier: 1878464
2026-01-28 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
2026-01-28 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c8c9280f-80a2-5a9f-8ff4-62992a506ece spider: ayvens.es
2026-01-28 20:02:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c8c9280f-80a2-5a9f-8ff4-62992a506ece due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c8c9280f-80a2-5a9f-8ff4-62992a506ece',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 134290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c9280f-80a2-5a9f-8ff4-62992a506ece/c8c9280f-80a2-5a9f-8ff4-62992a506ece_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/f9db14e7de8d46c59fc4c8d640cf82e1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Furgon BM TN L3H2 2.0TDI 103kW(140CV)',
 'transmission': 'manual',
 'trim': '35 Furgon BM TN L3H2 2.0TDI 103kW(140CV)',
 'vin': None,
 'year': 2022}
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878464%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [ayvens.es] INFO: Saving data for 1878464: {'created_time': 1769630564.435372, 'last_price_update_time': 1769630564.435383, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878464') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0fc94a84-3d83-52f2-8b73-704a1661d730 with identifier: 1878466
2026-01-28 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0fc94a84-3d83-52f2-8b73-704a1661d730 with identifier: 1878466
2026-01-28 20:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0fc94a84-3d83-52f2-8b73-704a1661d730 with identifier: 1878466 to the API
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/001/527fcf659e83430c8a918984c3a76b0b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0fc94a84-3d83-52f2-8b73-704a1661d730',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 126335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc94a84-3d83-52f2-8b73-704a1661d730/0fc94a84-3d83-52f2-8b73-704a1661d730_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/001/527fcf659e83430c8a918984c3a76b0b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P GT Line BlueHDi 120kW (160) S&S EAT8',
 'transmission': 'manual',
 'trim': '5P GT Line BlueHDi 120kW (160) S&S EAT8',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878466%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [ayvens.es] INFO: Saving data for 1878466: {'created_time': 1769630564.859495, 'last_price_update_time': 1769630564.859508, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878466') HTTP/1.1" 204 0
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca91d650>
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbc5038-f88e-5068-b4e2-97fe4eb2e107/8dbc5038-f88e-5068-b4e2-97fe4eb2e107_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F095%252F001ddc72beeb44baa73ab049c3469bc0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/095/001ddc72beeb44baa73ab049c3469bc0/images/large/1.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dbc5038-f88e-5068-b4e2-97fe4eb2e107
2026-01-28 20:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8dbc5038-f88e-5068-b4e2-97fe4eb2e107, skipping ID generation
2026-01-28 20:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 with scrape type 1
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 from tracking dictionaries
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 sending to next pipeline
2026-01-28 20:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8dbc5038-f88e-5068-b4e2-97fe4eb2e107, identifier: 1878465
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/122/525320d9b5f2448f8d2d3389156ecd79/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/031/71937cacd5414b83b84e0ebfdec9217d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 with identifier: 1878465
2026-01-28 20:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 with identifier: 1878465
2026-01-28 20:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 spider: ayvens.es
2026-01-28 20:02:45 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8dbc5038-f88e-5068-b4e2-97fe4eb2e107 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8dbc5038-f88e-5068-b4e2-97fe4eb2e107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 128761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbc5038-f88e-5068-b4e2-97fe4eb2e107/8dbc5038-f88e-5068-b4e2-97fe4eb2e107_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/095/001ddc72beeb44baa73ab049c3469bc0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Compact dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional Compact dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878465%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [ayvens.es] INFO: Saving data for 1878465: {'created_time': 1769630565.532958, 'last_price_update_time': 1769630565.532968, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878465') HTTP/1.1" 204 0
2026-01-28 20:02:45 [ayvens.es] INFO: Found listing with ID: 1878475
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878475%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [ayvens.es] INFO: Scrape type for 1878475: 1
2026-01-28 20:02:45 [ayvens.es] INFO: Extracting data for car ID: 1878475
2026-01-28 20:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e510a5a-a14f-5477-af16-140e1668ad12 with identifier: 1878475
2026-01-28 20:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e510a5a-a14f-5477-af16-140e1668ad12 with scrape type 1
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e510a5a-a14f-5477-af16-140e1668ad12
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F0f8cd59f123140c39c258e58d141a5da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/0f8cd59f123140c39c258e58d141a5da/images/large/1.jpg not downloaded yet
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81caa34790>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6918de53-6e25-5b75-b9fc-88eb8bd4ef62/6918de53-6e25-5b75-b9fc-88eb8bd4ef62_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F711%252F13b6055f2196465f9ccdb85b985b020c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/711/13b6055f2196465f9ccdb85b985b020c/images/large/1.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6918de53-6e25-5b75-b9fc-88eb8bd4ef62
2026-01-28 20:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6918de53-6e25-5b75-b9fc-88eb8bd4ef62, skipping ID generation
2026-01-28 20:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 with scrape type 1
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 from tracking dictionaries
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 sending to next pipeline
2026-01-28 20:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6918de53-6e25-5b75-b9fc-88eb8bd4ef62, identifier: 1878468
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/637/d934979b9ac2476482ff6b7293a8e500/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [ayvens.es] INFO: Found listing with ID: 1878476
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878476%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [ayvens.es] INFO: Scrape type for 1878476: 1
2026-01-28 20:02:45 [ayvens.es] INFO: Extracting data for car ID: 1878476
2026-01-28 20:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8509f302-7dce-53d1-aafc-451d06f3bfb6 with identifier: 1878476
2026-01-28 20:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8509f302-7dce-53d1-aafc-451d06f3bfb6 with scrape type 1
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8509f302-7dce-53d1-aafc-451d06f3bfb6
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F7516df74bb68427b8553e3a168ae1255%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/7516df74bb68427b8553e3a168ae1255/images/large/1.jpg not downloaded yet
2026-01-28 20:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 with identifier: 1878468
2026-01-28 20:02:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 with identifier: 1878468
2026-01-28 20:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6918de53-6e25-5b75-b9fc-88eb8bd4ef62 with identifier: 1878468 to the API
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/711/13b6055f2196465f9ccdb85b985b020c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'M',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6918de53-6e25-5b75-b9fc-88eb8bd4ef62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2',
 'odometer': 111131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6918de53-6e25-5b75-b9fc-88eb8bd4ef62/6918de53-6e25-5b75-b9fc-88eb8bd4ef62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/711/13b6055f2196465f9ccdb85b985b020c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 218dA Gran Coupe',
 'transmission': 'manual',
 'trim': '218dA Gran Coupe',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878468%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [ayvens.es] INFO: Saving data for 1878468: {'created_time': 1769630566.388299, 'last_price_update_time': 1769630566.38831, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878468') HTTP/1.1" 204 0
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81caa361d0>
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e759c3-aa3b-5f7b-bf4c-3be561d204dc/d5e759c3-aa3b-5f7b-bf4c-3be561d204dc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252F525320d9b5f2448f8d2d3389156ecd79%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/525320d9b5f2448f8d2d3389156ecd79/images/large/1.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5e759c3-aa3b-5f7b-bf4c-3be561d204dc
2026-01-28 20:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5e759c3-aa3b-5f7b-bf4c-3be561d204dc, skipping ID generation
2026-01-28 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e759c3-aa3b-5f7b-bf4c-3be561d204dc with scrape type 1
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d5e759c3-aa3b-5f7b-bf4c-3be561d204dc from tracking dictionaries
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5e759c3-aa3b-5f7b-bf4c-3be561d204dc sending to next pipeline
2026-01-28 20:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5e759c3-aa3b-5f7b-bf4c-3be561d204dc, identifier: 1878467
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca20f6d0>
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89141db0-4e6d-5c76-a64d-568ee3f2dc90/89141db0-4e6d-5c76-a64d-568ee3f2dc90_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F031%252F71937cacd5414b83b84e0ebfdec9217d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/031/71937cacd5414b83b84e0ebfdec9217d/images/large/1.jpg saved to cache
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89141db0-4e6d-5c76-a64d-568ee3f2dc90
2026-01-28 20:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89141db0-4e6d-5c76-a64d-568ee3f2dc90, skipping ID generation
2026-01-28 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89141db0-4e6d-5c76-a64d-568ee3f2dc90 with scrape type 1
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 89141db0-4e6d-5c76-a64d-568ee3f2dc90 from tracking dictionaries
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89141db0-4e6d-5c76-a64d-568ee3f2dc90 sending to next pipeline
2026-01-28 20:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89141db0-4e6d-5c76-a64d-568ee3f2dc90, identifier: 1878469
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/615/51d85820cc47407bb57b0a5b49af1b95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/222/8d566f6dc52e4acc89dacef299220280/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [ayvens.es] INFO: Found listing with ID: 1878477
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878477%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [ayvens.es] INFO: Scrape type for 1878477: 1
2026-01-28 20:02:47 [ayvens.es] INFO: Extracting data for car ID: 1878477
2026-01-28 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040c998b-c67d-5406-99f3-6cd6d99d9b4c with identifier: 1878477
2026-01-28 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040c998b-c67d-5406-99f3-6cd6d99d9b4c with scrape type 1
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 040c998b-c67d-5406-99f3-6cd6d99d9b4c
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252Fedb4517d00ce49a8aec6319b65f54487%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/edb4517d00ce49a8aec6319b65f54487/images/large/1.jpg not downloaded yet
2026-01-28 20:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5e759c3-aa3b-5f7b-bf4c-3be561d204dc with identifier: 1878467
2026-01-28 20:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5e759c3-aa3b-5f7b-bf4c-3be561d204dc with identifier: 1878467
2026-01-28 20:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
2026-01-28 20:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d5e759c3-aa3b-5f7b-bf4c-3be561d204dc spider: ayvens.es
2026-01-28 20:02:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d5e759c3-aa3b-5f7b-bf4c-3be561d204dc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd5e759c3-aa3b-5f7b-bf4c-3be561d204dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 84400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5e759c3-aa3b-5f7b-bf4c-3be561d204dc/d5e759c3-aa3b-5f7b-bf4c-3be561d204dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/122/525320d9b5f2448f8d2d3389156ecd79/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2018}
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878467%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [ayvens.es] INFO: Saving data for 1878467: {'created_time': 1769630567.520299, 'last_price_update_time': 1769630567.520312, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878467') HTTP/1.1" 204 0
2026-01-28 20:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89141db0-4e6d-5c76-a64d-568ee3f2dc90 with identifier: 1878469
2026-01-28 20:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89141db0-4e6d-5c76-a64d-568ee3f2dc90 with identifier: 1878469
2026-01-28 20:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89141db0-4e6d-5c76-a64d-568ee3f2dc90 with identifier: 1878469 to the API
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/031/71937cacd5414b83b84e0ebfdec9217d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89141db0-4e6d-5c76-a64d-568ee3f2dc90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 92078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89141db0-4e6d-5c76-a64d-568ee3f2dc90/89141db0-4e6d-5c76-a64d-568ee3f2dc90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/031/71937cacd5414b83b84e0ebfdec9217d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure BlueHDi 96kW (130CV) S&S EAT8',
 'transmission': 'manual',
 'trim': 'Allure BlueHDi 96kW (130CV) S&S EAT8',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878469%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [ayvens.es] INFO: Saving data for 1878469: {'created_time': 1769630568.071633, 'last_price_update_time': 1769630568.071645, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878469') HTTP/1.1" 204 0
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca88bc90>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2961df-e169-5ad5-b70b-9bbb8bd74878/0e2961df-e169-5ad5-b70b-9bbb8bd74878_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F637%252Fd934979b9ac2476482ff6b7293a8e500%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/637/d934979b9ac2476482ff6b7293a8e500/images/large/1.jpg saved to cache
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e2961df-e169-5ad5-b70b-9bbb8bd74878
2026-01-28 20:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e2961df-e169-5ad5-b70b-9bbb8bd74878, skipping ID generation
2026-01-28 20:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2961df-e169-5ad5-b70b-9bbb8bd74878 with scrape type 1
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0e2961df-e169-5ad5-b70b-9bbb8bd74878 from tracking dictionaries
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e2961df-e169-5ad5-b70b-9bbb8bd74878 sending to next pipeline
2026-01-28 20:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e2961df-e169-5ad5-b70b-9bbb8bd74878, identifier: 1878470
2026-01-28 20:02:48 [ayvens.es] INFO: Found listing with ID: 1878478
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878478%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [ayvens.es] INFO: Scrape type for 1878478: 1
2026-01-28 20:02:48 [ayvens.es] INFO: Extracting data for car ID: 1878478
2026-01-28 20:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bbe4be4-90a9-55a3-a576-f13cef4fce8e with identifier: 1878478
2026-01-28 20:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bbe4be4-90a9-55a3-a576-f13cef4fce8e with scrape type 1
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6bbe4be4-90a9-55a3-a576-f13cef4fce8e
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F680%252F52a43b2caa7941af8df8429bef4c6b39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/680/52a43b2caa7941af8df8429bef4c6b39/images/large/1.jpg not downloaded yet
2026-01-28 20:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e2961df-e169-5ad5-b70b-9bbb8bd74878 with identifier: 1878470
2026-01-28 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e2961df-e169-5ad5-b70b-9bbb8bd74878 with identifier: 1878470
2026-01-28 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164612 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164612
2026-01-28 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0e2961df-e169-5ad5-b70b-9bbb8bd74878 spider: ayvens.es
2026-01-28 20:02:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0e2961df-e169-5ad5-b70b-9bbb8bd74878 due to rule: high_mileage_for_country.json, error: 164612 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164612
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e2961df-e169-5ad5-b70b-9bbb8bd74878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 164612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2961df-e169-5ad5-b70b-9bbb8bd74878/0e2961df-e169-5ad5-b70b-9bbb8bd74878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/637/d934979b9ac2476482ff6b7293a8e500/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style BlueHDi 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Style BlueHDi 130 S&S',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878470%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [ayvens.es] INFO: Saving data for 1878470: {'created_time': 1769630568.747438, 'last_price_update_time': 1769630568.747451, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878470') HTTP/1.1" 204 0
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca863b10>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba/6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F51d85820cc47407bb57b0a5b49af1b95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/51d85820cc47407bb57b0a5b49af1b95/images/large/1.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba
2026-01-28 20:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba, skipping ID generation
2026-01-28 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba with scrape type 1
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba from tracking dictionaries
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba sending to next pipeline
2026-01-28 20:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba, identifier: 1878471
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca20cd90>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1787ca2-e3cd-56e5-890c-797a121014bd/e1787ca2-e3cd-56e5-890c-797a121014bd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F222%252F8d566f6dc52e4acc89dacef299220280%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/222/8d566f6dc52e4acc89dacef299220280/images/large/1.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1787ca2-e3cd-56e5-890c-797a121014bd
2026-01-28 20:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1787ca2-e3cd-56e5-890c-797a121014bd, skipping ID generation
2026-01-28 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1787ca2-e3cd-56e5-890c-797a121014bd with scrape type 1
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1787ca2-e3cd-56e5-890c-797a121014bd from tracking dictionaries
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1787ca2-e3cd-56e5-890c-797a121014bd sending to next pipeline
2026-01-28 20:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e1787ca2-e3cd-56e5-890c-797a121014bd, identifier: 1878472
2026-01-28 20:02:49 [ayvens.es] INFO: Found listing with ID: 1878479
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878479%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [ayvens.es] INFO: Scrape type for 1878479: 1
2026-01-28 20:02:49 [ayvens.es] INFO: Extracting data for car ID: 1878479
2026-01-28 20:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db9e6f77-b848-5308-834e-0bf1814c0543 with identifier: 1878479
2026-01-28 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db9e6f77-b848-5308-834e-0bf1814c0543 with scrape type 1
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item db9e6f77-b848-5308-834e-0bf1814c0543
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252Ff08b004da6f24bd1ad6885132750291d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/f08b004da6f24bd1ad6885132750291d/images/large/1.jpg not downloaded yet
2026-01-28 20:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba with identifier: 1878471
2026-01-28 20:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba with identifier: 1878471
2026-01-28 20:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba with identifier: 1878471 to the API
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/615/51d85820cc47407bb57b0a5b49af1b95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 135713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba/6a3ad9fc-d3ad-53f0-a6bc-c82594f45dba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/615/51d85820cc47407bb57b0a5b49af1b95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Sport 2.0 TDI 140kW (190CV) 4Motion DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 140kW (190CV) 4Motion DSG',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878471%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [ayvens.es] INFO: Saving data for 1878471: {'created_time': 1769630570.207434, 'last_price_update_time': 1769630570.207444, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878471') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e1787ca2-e3cd-56e5-890c-797a121014bd with identifier: 1878472
2026-01-28 20:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e1787ca2-e3cd-56e5-890c-797a121014bd with identifier: 1878472
2026-01-28 20:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-28 20:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e1787ca2-e3cd-56e5-890c-797a121014bd spider: ayvens.es
2026-01-28 20:02:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e1787ca2-e3cd-56e5-890c-797a121014bd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e1787ca2-e3cd-56e5-890c-797a121014bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 56700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1787ca2-e3cd-56e5-890c-797a121014bd/e1787ca2-e3cd-56e5-890c-797a121014bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/222/8d566f6dc52e4acc89dacef299220280/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO L1 1.5 Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'L1 1.5 Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2023}
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878472%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [ayvens.es] INFO: Saving data for 1878472: {'created_time': 1769630570.481604, 'last_price_update_time': 1769630570.481617, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878472') HTTP/1.1" 204 0
2026-01-28 20:02:50 [ayvens.es] INFO: Found listing with ID: 1878480
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878480%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [ayvens.es] INFO: Scrape type for 1878480: 1
2026-01-28 20:02:50 [ayvens.es] INFO: Extracting data for car ID: 1878480
2026-01-28 20:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a10e3585-6ac2-5c91-a58d-d40b7b217c7e with identifier: 1878480
2026-01-28 20:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a10e3585-6ac2-5c91-a58d-d40b7b217c7e with scrape type 1
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a10e3585-6ac2-5c91-a58d-d40b7b217c7e
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F335%252F79e101731eac48578059d652fa6a1227%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/335/79e101731eac48578059d652fa6a1227/images/large/1.jpg not downloaded yet
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/350/66426d34debc4fdfa39917e931828b9a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/556/80407aa4dd9b4bf49868d2505fc601d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:50 [ayvens.es] INFO: Found listing with ID: 1878481
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878481%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [ayvens.es] INFO: Scrape type for 1878481: 1
2026-01-28 20:02:50 [ayvens.es] INFO: Extracting data for car ID: 1878481
2026-01-28 20:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b970e699-2fe2-561d-a5f8-0ae3b04096b7 with identifier: 1878481
2026-01-28 20:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b970e699-2fe2-561d-a5f8-0ae3b04096b7 with scrape type 1
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b970e699-2fe2-561d-a5f8-0ae3b04096b7
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F119%252F0c823961c9a34ead8035f9268006c218%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/119/0c823961c9a34ead8035f9268006c218/images/large/1.jpg not downloaded yet
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/415/0f8cd59f123140c39c258e58d141a5da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:50 [ayvens.es] INFO: Found listing with ID: 1878482
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878482%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [ayvens.es] INFO: Scrape type for 1878482: 1
2026-01-28 20:02:50 [ayvens.es] INFO: Extracting data for car ID: 1878482
2026-01-28 20:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d220afa5-b4d7-522e-991f-01084e4ef561 with identifier: 1878482
2026-01-28 20:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d220afa5-b4d7-522e-991f-01084e4ef561 with scrape type 1
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d220afa5-b4d7-522e-991f-01084e4ef561
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252F5b9c1aa70c364deea97a6a37b48eaac8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/5b9c1aa70c364deea97a6a37b48eaac8/images/large/1.jpg not downloaded yet
2026-01-28 20:02:50 [ayvens.es] INFO: Found listing with ID: 1878483
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878483%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [ayvens.es] INFO: Scrape type for 1878483: 1
2026-01-28 20:02:50 [ayvens.es] INFO: Extracting data for car ID: 1878483
2026-01-28 20:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f with identifier: 1878483
2026-01-28 20:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f with scrape type 1
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F169%252F6d052c559e18459e8b641f9fa508acf7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/169/6d052c559e18459e8b641f9fa508acf7/images/large/1.jpg not downloaded yet
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/7516df74bb68427b8553e3a168ae1255/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/966/edb4517d00ce49a8aec6319b65f54487/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:50 [ayvens.es] INFO: Found listing with ID: 1878484
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878484%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [ayvens.es] INFO: Scrape type for 1878484: 1
2026-01-28 20:02:50 [ayvens.es] INFO: Extracting data for car ID: 1878484
2026-01-28 20:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d85479-d1ff-5d38-ab8d-f67824646c28 with identifier: 1878484
2026-01-28 20:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d85479-d1ff-5d38-ab8d-f67824646c28 with scrape type 1
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8d85479-d1ff-5d38-ab8d-f67824646c28
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F033%252F0b71012f0e7947b4941a9a03582a0b29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/033/0b71012f0e7947b4941a9a03582a0b29/images/large/1.jpg not downloaded yet
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca85b350>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6/5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F350%252F66426d34debc4fdfa39917e931828b9a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/350/66426d34debc4fdfa39917e931828b9a/images/large/1.jpg saved to cache
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6
2026-01-28 20:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6, skipping ID generation
2026-01-28 20:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 with scrape type 1
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 from tracking dictionaries
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 sending to next pipeline
2026-01-28 20:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6, identifier: 1878473
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c915b410>
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b7e0087-366c-536e-8e4d-72ecec9fa93e/4b7e0087-366c-536e-8e4d-72ecec9fa93e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F556%252F80407aa4dd9b4bf49868d2505fc601d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/556/80407aa4dd9b4bf49868d2505fc601d9/images/large/1.jpg saved to cache
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b7e0087-366c-536e-8e4d-72ecec9fa93e
2026-01-28 20:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b7e0087-366c-536e-8e4d-72ecec9fa93e, skipping ID generation
2026-01-28 20:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b7e0087-366c-536e-8e4d-72ecec9fa93e with scrape type 1
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4b7e0087-366c-536e-8e4d-72ecec9fa93e from tracking dictionaries
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b7e0087-366c-536e-8e4d-72ecec9fa93e sending to next pipeline
2026-01-28 20:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4b7e0087-366c-536e-8e4d-72ecec9fa93e, identifier: 1878474
2026-01-28 20:02:51 [ayvens.es] INFO: Found listing with ID: 1878485
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878485%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [ayvens.es] INFO: Scrape type for 1878485: 1
2026-01-28 20:02:51 [ayvens.es] INFO: Extracting data for car ID: 1878485
2026-01-28 20:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ae6029-c977-530f-b71a-413c2adb65f2 with identifier: 1878485
2026-01-28 20:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ae6029-c977-530f-b71a-413c2adb65f2 with scrape type 1
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69ae6029-c977-530f-b71a-413c2adb65f2
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252F69958a3d96ab4e038614a6d60ee75736%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg not downloaded yet
2026-01-28 20:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 with identifier: 1878473
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 with identifier: 1878473
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 spider: ayvens.es
2026-01-28 20:02:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 196997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6/5fd1b44c-af6d-5ea9-9f8c-ad0f0d9cb8f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/350/66426d34debc4fdfa39917e931828b9a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878473%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [ayvens.es] INFO: Saving data for 1878473: {'created_time': 1769630571.848548, 'last_price_update_time': 1769630571.848558, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878473') HTTP/1.1" 204 0
2026-01-28 20:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4b7e0087-366c-536e-8e4d-72ecec9fa93e with identifier: 1878474
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4b7e0087-366c-536e-8e4d-72ecec9fa93e with identifier: 1878474
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4b7e0087-366c-536e-8e4d-72ecec9fa93e spider: ayvens.es
2026-01-28 20:02:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 4b7e0087-366c-536e-8e4d-72ecec9fa93e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4b7e0087-366c-536e-8e4d-72ecec9fa93e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 125757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b7e0087-366c-536e-8e4d-72ecec9fa93e/4b7e0087-366c-536e-8e4d-72ecec9fa93e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/556/80407aa4dd9b4bf49868d2505fc601d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 FEEL',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878474%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [ayvens.es] INFO: Saving data for 1878474: {'created_time': 1769630572.098974, 'last_price_update_time': 1769630572.098987, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878474') HTTP/1.1" 204 0
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fe1510>
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e510a5a-a14f-5477-af16-140e1668ad12/3e510a5a-a14f-5477-af16-140e1668ad12_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F0f8cd59f123140c39c258e58d141a5da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/0f8cd59f123140c39c258e58d141a5da/images/large/1.jpg saved to cache
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e510a5a-a14f-5477-af16-140e1668ad12
2026-01-28 20:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e510a5a-a14f-5477-af16-140e1668ad12, skipping ID generation
2026-01-28 20:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e510a5a-a14f-5477-af16-140e1668ad12 with scrape type 1
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3e510a5a-a14f-5477-af16-140e1668ad12 from tracking dictionaries
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e510a5a-a14f-5477-af16-140e1668ad12 sending to next pipeline
2026-01-28 20:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e510a5a-a14f-5477-af16-140e1668ad12, identifier: 1878475
2026-01-28 20:02:52 [ayvens.es] INFO: Found listing with ID: 1878486
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878486%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [ayvens.es] INFO: Scrape type for 1878486: 1
2026-01-28 20:02:52 [ayvens.es] INFO: Extracting data for car ID: 1878486
2026-01-28 20:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33edc02e-f832-564e-bfa9-71e230ad9173 with identifier: 1878486
2026-01-28 20:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33edc02e-f832-564e-bfa9-71e230ad9173 with scrape type 1
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33edc02e-f832-564e-bfa9-71e230ad9173
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F981%252Fa8d2e01a90454a8ab33c3f3c5c7297fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/981/a8d2e01a90454a8ab33c3f3c5c7297fd/images/large/1.jpg not downloaded yet
2026-01-28 20:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e510a5a-a14f-5477-af16-140e1668ad12 with identifier: 1878475
2026-01-28 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e510a5a-a14f-5477-af16-140e1668ad12 with identifier: 1878475
2026-01-28 20:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e510a5a-a14f-5477-af16-140e1668ad12 with identifier: 1878475 to the API
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/415/0f8cd59f123140c39c258e58d141a5da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e510a5a-a14f-5477-af16-140e1668ad12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 103289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e510a5a-a14f-5477-af16-140e1668ad12/3e510a5a-a14f-5477-af16-140e1668ad12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/415/0f8cd59f123140c39c258e58d141a5da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878475%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [ayvens.es] INFO: Saving data for 1878475: {'created_time': 1769630573.082004, 'last_price_update_time': 1769630573.082015, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878475') HTTP/1.1" 204 0
2026-01-28 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/680/52a43b2caa7941af8df8429bef4c6b39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca20f6d0>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8509f302-7dce-53d1-aafc-451d06f3bfb6/8509f302-7dce-53d1-aafc-451d06f3bfb6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F7516df74bb68427b8553e3a168ae1255%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/7516df74bb68427b8553e3a168ae1255/images/large/1.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8509f302-7dce-53d1-aafc-451d06f3bfb6
2026-01-28 20:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8509f302-7dce-53d1-aafc-451d06f3bfb6, skipping ID generation
2026-01-28 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8509f302-7dce-53d1-aafc-451d06f3bfb6 with scrape type 1
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8509f302-7dce-53d1-aafc-451d06f3bfb6 from tracking dictionaries
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8509f302-7dce-53d1-aafc-451d06f3bfb6 sending to next pipeline
2026-01-28 20:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8509f302-7dce-53d1-aafc-451d06f3bfb6, identifier: 1878476
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca91e490>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040c998b-c67d-5406-99f3-6cd6d99d9b4c/040c998b-c67d-5406-99f3-6cd6d99d9b4c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252Fedb4517d00ce49a8aec6319b65f54487%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/edb4517d00ce49a8aec6319b65f54487/images/large/1.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 040c998b-c67d-5406-99f3-6cd6d99d9b4c
2026-01-28 20:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 040c998b-c67d-5406-99f3-6cd6d99d9b4c, skipping ID generation
2026-01-28 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040c998b-c67d-5406-99f3-6cd6d99d9b4c with scrape type 1
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 040c998b-c67d-5406-99f3-6cd6d99d9b4c from tracking dictionaries
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 040c998b-c67d-5406-99f3-6cd6d99d9b4c sending to next pipeline
2026-01-28 20:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 040c998b-c67d-5406-99f3-6cd6d99d9b4c, identifier: 1878477
2026-01-28 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/379/f08b004da6f24bd1ad6885132750291d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:53 [ayvens.es] INFO: Found listing with ID: 1878487
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878487%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [ayvens.es] INFO: Scrape type for 1878487: 1
2026-01-28 20:02:53 [ayvens.es] INFO: Extracting data for car ID: 1878487
2026-01-28 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 with identifier: 1878487
2026-01-28 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 with scrape type 1
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F778%252F7806372dfa384c5d8cf1ecb727bf6bab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/778/7806372dfa384c5d8cf1ecb727bf6bab/images/large/1.jpg not downloaded yet
2026-01-28 20:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8509f302-7dce-53d1-aafc-451d06f3bfb6 with identifier: 1878476
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8509f302-7dce-53d1-aafc-451d06f3bfb6 with identifier: 1878476
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8509f302-7dce-53d1-aafc-451d06f3bfb6 spider: ayvens.es
2026-01-28 20:02:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8509f302-7dce-53d1-aafc-451d06f3bfb6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8509f302-7dce-53d1-aafc-451d06f3bfb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 53801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8509f302-7dce-53d1-aafc-451d06f3bfb6/8509f302-7dce-53d1-aafc-451d06f3bfb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/7516df74bb68427b8553e3a168ae1255/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Standard 600kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Pro Standard 600kg BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878476%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [ayvens.es] INFO: Saving data for 1878476: {'created_time': 1769630574.264536, 'last_price_update_time': 1769630574.264551, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878476') HTTP/1.1" 204 0
2026-01-28 20:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 040c998b-c67d-5406-99f3-6cd6d99d9b4c with identifier: 1878477
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 040c998b-c67d-5406-99f3-6cd6d99d9b4c with identifier: 1878477
2026-01-28 20:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 040c998b-c67d-5406-99f3-6cd6d99d9b4c with identifier: 1878477 to the API
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/966/edb4517d00ce49a8aec6319b65f54487/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '040c998b-c67d-5406-99f3-6cd6d99d9b4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 97786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040c998b-c67d-5406-99f3-6cd6d99d9b4c/040c998b-c67d-5406-99f3-6cd6d99d9b4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/966/edb4517d00ce49a8aec6319b65f54487/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878477%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [ayvens.es] INFO: Saving data for 1878477: {'created_time': 1769630574.691752, 'last_price_update_time': 1769630574.691765, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878477') HTTP/1.1" 204 0
2026-01-28 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/169/6d052c559e18459e8b641f9fa508acf7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:54 [ayvens.es] INFO: Found listing with ID: 1878488
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878488%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [ayvens.es] INFO: Scrape type for 1878488: 1
2026-01-28 20:02:54 [ayvens.es] INFO: Extracting data for car ID: 1878488
2026-01-28 20:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bad3dd1e-3194-5266-a4a7-f829cb0732a5 with identifier: 1878488
2026-01-28 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bad3dd1e-3194-5266-a4a7-f829cb0732a5 with scrape type 1
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bad3dd1e-3194-5266-a4a7-f829cb0732a5
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F59fd24fff5c8481bbca5932f7dab1b72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/59fd24fff5c8481bbca5932f7dab1b72/images/large/1.jpg not downloaded yet
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca9d6e90>
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbe4be4-90a9-55a3-a576-f13cef4fce8e/6bbe4be4-90a9-55a3-a576-f13cef4fce8e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F680%252F52a43b2caa7941af8df8429bef4c6b39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/680/52a43b2caa7941af8df8429bef4c6b39/images/large/1.jpg saved to cache
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bbe4be4-90a9-55a3-a576-f13cef4fce8e
2026-01-28 20:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bbe4be4-90a9-55a3-a576-f13cef4fce8e, skipping ID generation
2026-01-28 20:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bbe4be4-90a9-55a3-a576-f13cef4fce8e with scrape type 1
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6bbe4be4-90a9-55a3-a576-f13cef4fce8e from tracking dictionaries
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bbe4be4-90a9-55a3-a576-f13cef4fce8e sending to next pipeline
2026-01-28 20:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6bbe4be4-90a9-55a3-a576-f13cef4fce8e, identifier: 1878478
2026-01-28 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6bbe4be4-90a9-55a3-a576-f13cef4fce8e with identifier: 1878478
2026-01-28 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6bbe4be4-90a9-55a3-a576-f13cef4fce8e with identifier: 1878478
2026-01-28 20:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6bbe4be4-90a9-55a3-a576-f13cef4fce8e with identifier: 1878478 to the API
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/680/52a43b2caa7941af8df8429bef4c6b39/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6bbe4be4-90a9-55a3-a576-f13cef4fce8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB',
 'odometer': 147147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbe4be4-90a9-55a3-a576-f13cef4fce8e/6bbe4be4-90a9-55a3-a576-f13cef4fce8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/680/52a43b2caa7941af8df8429bef4c6b39/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB Combi 2.0 TDI 110kW (150CV) DSG Style',
 'transmission': 'manual',
 'trim': 'Combi 2.0 TDI 110kW (150CV) DSG Style',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878478%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [ayvens.es] INFO: Saving data for 1878478: {'created_time': 1769630575.874938, 'last_price_update_time': 1769630575.874951, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878478') HTTP/1.1" 204 0
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1ff190>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9e6f77-b848-5308-834e-0bf1814c0543/db9e6f77-b848-5308-834e-0bf1814c0543_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252Ff08b004da6f24bd1ad6885132750291d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/f08b004da6f24bd1ad6885132750291d/images/large/1.jpg saved to cache
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db9e6f77-b848-5308-834e-0bf1814c0543
2026-01-28 20:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db9e6f77-b848-5308-834e-0bf1814c0543, skipping ID generation
2026-01-28 20:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db9e6f77-b848-5308-834e-0bf1814c0543 with scrape type 1
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db9e6f77-b848-5308-834e-0bf1814c0543 from tracking dictionaries
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db9e6f77-b848-5308-834e-0bf1814c0543 sending to next pipeline
2026-01-28 20:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: db9e6f77-b848-5308-834e-0bf1814c0543, identifier: 1878479
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/119/0c823961c9a34ead8035f9268006c218/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/335/79e101731eac48578059d652fa6a1227/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/451/5b9c1aa70c364deea97a6a37b48eaac8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [ayvens.es] INFO: Found listing with ID: 1878489
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878489%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [ayvens.es] INFO: Scrape type for 1878489: 1
2026-01-28 20:02:56 [ayvens.es] INFO: Extracting data for car ID: 1878489
2026-01-28 20:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcfd636-c35e-5d65-9ce5-4d7f403891ef with identifier: 1878489
2026-01-28 20:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcfd636-c35e-5d65-9ce5-4d7f403891ef with scrape type 1
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afcfd636-c35e-5d65-9ce5-4d7f403891ef
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F180%252F950eacf253b647289d9f5d2e232a33b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/180/950eacf253b647289d9f5d2e232a33b3/images/large/1.jpg not downloaded yet
2026-01-28 20:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: db9e6f77-b848-5308-834e-0bf1814c0543 with identifier: 1878479
2026-01-28 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: db9e6f77-b848-5308-834e-0bf1814c0543 with identifier: 1878479
2026-01-28 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137606 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137606
2026-01-28 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: db9e6f77-b848-5308-834e-0bf1814c0543 spider: ayvens.es
2026-01-28 20:02:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: db9e6f77-b848-5308-834e-0bf1814c0543 due to rule: high_mileage_for_make.json, error: 137606 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137606
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'db9e6f77-b848-5308-834e-0bf1814c0543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 137606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9e6f77-b848-5308-834e-0bf1814c0543/db9e6f77-b848-5308-834e-0bf1814c0543_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/379/f08b004da6f24bd1ad6885132750291d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Lounge',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Lounge',
 'vin': None,
 'year': 2017}
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878479%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [ayvens.es] INFO: Saving data for 1878479: {'created_time': 1769630576.784551, 'last_price_update_time': 1769630576.784562, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878479') HTTP/1.1" 204 0
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912aa10>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f/96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F169%252F6d052c559e18459e8b641f9fa508acf7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/169/6d052c559e18459e8b641f9fa508acf7/images/large/1.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f
2026-01-28 20:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f, skipping ID generation
2026-01-28 20:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f with scrape type 1
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f from tracking dictionaries
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f sending to next pipeline
2026-01-28 20:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f, identifier: 1878483
2026-01-28 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/033/0b71012f0e7947b4941a9a03582a0b29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:57 [ayvens.es] INFO: Found listing with ID: 1878490
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878490%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [ayvens.es] INFO: Scrape type for 1878490: 1
2026-01-28 20:02:57 [ayvens.es] INFO: Extracting data for car ID: 1878490
2026-01-28 20:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 with identifier: 1878490
2026-01-28 20:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 with scrape type 1
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252Ff0a058b3229a4deba9778ef6e017ba8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/f0a058b3229a4deba9778ef6e017ba8b/images/large/1.jpg not downloaded yet
2026-01-28 20:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f with identifier: 1878483
2026-01-28 20:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f with identifier: 1878483
2026-01-28 20:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160584 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160584
2026-01-28 20:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f spider: ayvens.es
2026-01-28 20:02:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f due to rule: high_mileage_for_country.json, error: 160584 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160584
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 160584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f/96970bc4-4ff7-5b7f-82ce-9a1a1c287b5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/169/6d052c559e18459e8b641f9fa508acf7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 BlueHdi 130 S&S EAT8 Shine',
 'transmission': 'manual',
 'trim': 'BlueHdi 130 S&S EAT8 Shine',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878483%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [ayvens.es] INFO: Saving data for 1878483: {'created_time': 1769630577.719644, 'last_price_update_time': 1769630577.719655, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878483') HTTP/1.1" 204 0
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9119090>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b970e699-2fe2-561d-a5f8-0ae3b04096b7/b970e699-2fe2-561d-a5f8-0ae3b04096b7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F119%252F0c823961c9a34ead8035f9268006c218%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/119/0c823961c9a34ead8035f9268006c218/images/large/1.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b970e699-2fe2-561d-a5f8-0ae3b04096b7
2026-01-28 20:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b970e699-2fe2-561d-a5f8-0ae3b04096b7, skipping ID generation
2026-01-28 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b970e699-2fe2-561d-a5f8-0ae3b04096b7 with scrape type 1
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b970e699-2fe2-561d-a5f8-0ae3b04096b7 from tracking dictionaries
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b970e699-2fe2-561d-a5f8-0ae3b04096b7 sending to next pipeline
2026-01-28 20:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b970e699-2fe2-561d-a5f8-0ae3b04096b7, identifier: 1878481
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1e79d0>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a10e3585-6ac2-5c91-a58d-d40b7b217c7e/a10e3585-6ac2-5c91-a58d-d40b7b217c7e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F335%252F79e101731eac48578059d652fa6a1227%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/335/79e101731eac48578059d652fa6a1227/images/large/1.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a10e3585-6ac2-5c91-a58d-d40b7b217c7e
2026-01-28 20:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a10e3585-6ac2-5c91-a58d-d40b7b217c7e, skipping ID generation
2026-01-28 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a10e3585-6ac2-5c91-a58d-d40b7b217c7e with scrape type 1
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a10e3585-6ac2-5c91-a58d-d40b7b217c7e from tracking dictionaries
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a10e3585-6ac2-5c91-a58d-d40b7b217c7e sending to next pipeline
2026-01-28 20:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a10e3585-6ac2-5c91-a58d-d40b7b217c7e, identifier: 1878480
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca861c10>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d220afa5-b4d7-522e-991f-01084e4ef561/d220afa5-b4d7-522e-991f-01084e4ef561_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252F5b9c1aa70c364deea97a6a37b48eaac8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/5b9c1aa70c364deea97a6a37b48eaac8/images/large/1.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d220afa5-b4d7-522e-991f-01084e4ef561
2026-01-28 20:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d220afa5-b4d7-522e-991f-01084e4ef561, skipping ID generation
2026-01-28 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d220afa5-b4d7-522e-991f-01084e4ef561 with scrape type 1
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d220afa5-b4d7-522e-991f-01084e4ef561 from tracking dictionaries
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d220afa5-b4d7-522e-991f-01084e4ef561 sending to next pipeline
2026-01-28 20:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d220afa5-b4d7-522e-991f-01084e4ef561, identifier: 1878482
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [ayvens.es] INFO: Found listing with ID: 1878491
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878491%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [ayvens.es] INFO: Scrape type for 1878491: 1
2026-01-28 20:02:59 [ayvens.es] INFO: Extracting data for car ID: 1878491
2026-01-28 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa39364-9b56-5203-b0ef-b4dbda3a90aa with identifier: 1878491
2026-01-28 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa39364-9b56-5203-b0ef-b4dbda3a90aa with scrape type 1
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0aa39364-9b56-5203-b0ef-b4dbda3a90aa
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F807%252F6747afa71f2146b99e69c6d7344d2f34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/807/6747afa71f2146b99e69c6d7344d2f34/images/large/1.jpg not downloaded yet
2026-01-28 20:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b970e699-2fe2-561d-a5f8-0ae3b04096b7 with identifier: 1878481
2026-01-28 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b970e699-2fe2-561d-a5f8-0ae3b04096b7 with identifier: 1878481
2026-01-28 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b970e699-2fe2-561d-a5f8-0ae3b04096b7 spider: ayvens.es
2026-01-28 20:02:59 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b970e699-2fe2-561d-a5f8-0ae3b04096b7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b970e699-2fe2-561d-a5f8-0ae3b04096b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 176318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b970e699-2fe2-561d-a5f8-0ae3b04096b7/b970e699-2fe2-561d-a5f8-0ae3b04096b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/119/0c823961c9a34ead8035f9268006c218/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 FEEL',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878481%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [ayvens.es] INFO: Saving data for 1878481: {'created_time': 1769630579.353816, 'last_price_update_time': 1769630579.35383, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878481') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a10e3585-6ac2-5c91-a58d-d40b7b217c7e with identifier: 1878480
2026-01-28 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a10e3585-6ac2-5c91-a58d-d40b7b217c7e with identifier: 1878480
2026-01-28 20:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a10e3585-6ac2-5c91-a58d-d40b7b217c7e with identifier: 1878480 to the API
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/335/79e101731eac48578059d652fa6a1227/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a10e3585-6ac2-5c91-a58d-d40b7b217c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 131640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a10e3585-6ac2-5c91-a58d-d40b7b217c7e/a10e3585-6ac2-5c91-a58d-d40b7b217c7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/335/79e101731eac48578059d652fa6a1227/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2020}
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878480%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [ayvens.es] INFO: Saving data for 1878480: {'created_time': 1769630579.781332, 'last_price_update_time': 1769630579.781343, 'auction_closing_time': 1769688000.0}
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878480') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d220afa5-b4d7-522e-991f-01084e4ef561 with identifier: 1878482
2026-01-28 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d220afa5-b4d7-522e-991f-01084e4ef561 with identifier: 1878482
2026-01-28 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2026-01-28 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d220afa5-b4d7-522e-991f-01084e4ef561 spider: ayvens.es
2026-01-28 20:03:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d220afa5-b4d7-522e-991f-01084e4ef561 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd220afa5-b4d7-522e-991f-01084e4ef561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 73163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d220afa5-b4d7-522e-991f-01084e4ef561/d220afa5-b4d7-522e-991f-01084e4ef561_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/451/5b9c1aa70c364deea97a6a37b48eaac8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 75kW (102CV) BMT',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 75kW (102CV) BMT',
 'vin': None,
 'year': 2018}
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878482%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [ayvens.es] INFO: Saving data for 1878482: {'created_time': 1769630580.082419, 'last_price_update_time': 1769630580.082431, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878482') HTTP/1.1" 204 0
2026-01-28 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/981/a8d2e01a90454a8ab33c3f3c5c7297fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fe6210>
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d85479-d1ff-5d38-ab8d-f67824646c28/c8d85479-d1ff-5d38-ab8d-f67824646c28_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F033%252F0b71012f0e7947b4941a9a03582a0b29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/033/0b71012f0e7947b4941a9a03582a0b29/images/large/1.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8d85479-d1ff-5d38-ab8d-f67824646c28
2026-01-28 20:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8d85479-d1ff-5d38-ab8d-f67824646c28, skipping ID generation
2026-01-28 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d85479-d1ff-5d38-ab8d-f67824646c28 with scrape type 1
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c8d85479-d1ff-5d38-ab8d-f67824646c28 from tracking dictionaries
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8d85479-d1ff-5d38-ab8d-f67824646c28 sending to next pipeline
2026-01-28 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8d85479-d1ff-5d38-ab8d-f67824646c28, identifier: 1878484
2026-01-28 20:03:00 [ayvens.es] INFO: Found listing with ID: 1878492
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878492%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [ayvens.es] INFO: Scrape type for 1878492: 1
2026-01-28 20:03:00 [ayvens.es] INFO: Extracting data for car ID: 1878492
2026-01-28 20:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa694974-e86f-5686-8782-fb3f799e8e9f with identifier: 1878492
2026-01-28 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa694974-e86f-5686-8782-fb3f799e8e9f with scrape type 1
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fa694974-e86f-5686-8782-fb3f799e8e9f
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F965775793ac142dc87dcd1771f996de4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/965775793ac142dc87dcd1771f996de4/images/large/1.jpg not downloaded yet
2026-01-28 20:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8d85479-d1ff-5d38-ab8d-f67824646c28 with identifier: 1878484
2026-01-28 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8d85479-d1ff-5d38-ab8d-f67824646c28 with identifier: 1878484
2026-01-28 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-28 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c8d85479-d1ff-5d38-ab8d-f67824646c28 spider: ayvens.es
2026-01-28 20:03:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c8d85479-d1ff-5d38-ab8d-f67824646c28 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c8d85479-d1ff-5d38-ab8d-f67824646c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 64193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d85479-d1ff-5d38-ab8d-f67824646c28/c8d85479-d1ff-5d38-ab8d-f67824646c28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/033/0b71012f0e7947b4941a9a03582a0b29/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 120 S&S 6v Control (CA)',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 120 S&S 6v Control (CA)',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878484%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [ayvens.es] INFO: Saving data for 1878484: {'created_time': 1769630580.842468, 'last_price_update_time': 1769630580.84248, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878484') HTTP/1.1" 204 0
2026-01-28 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/778/7806372dfa384c5d8cf1ecb727bf6bab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91516d0>
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ae6029-c977-530f-b71a-413c2adb65f2/69ae6029-c977-530f-b71a-413c2adb65f2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252F69958a3d96ab4e038614a6d60ee75736%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69ae6029-c977-530f-b71a-413c2adb65f2
2026-01-28 20:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69ae6029-c977-530f-b71a-413c2adb65f2, skipping ID generation
2026-01-28 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ae6029-c977-530f-b71a-413c2adb65f2 with scrape type 1
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 69ae6029-c977-530f-b71a-413c2adb65f2 from tracking dictionaries
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69ae6029-c977-530f-b71a-413c2adb65f2 sending to next pipeline
2026-01-28 20:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69ae6029-c977-530f-b71a-413c2adb65f2, identifier: 1878485
2026-01-28 20:03:01 [ayvens.es] INFO: Found listing with ID: 1878493
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878493%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [ayvens.es] INFO: Scrape type for 1878493: 1
2026-01-28 20:03:01 [ayvens.es] INFO: Extracting data for car ID: 1878493
2026-01-28 20:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 with identifier: 1878493
2026-01-28 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 with scrape type 1
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F841%252Fa91385da07934d078b2e19a1e4a011b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/841/a91385da07934d078b2e19a1e4a011b3/images/large/1.jpg not downloaded yet
2026-01-28 20:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69ae6029-c977-530f-b71a-413c2adb65f2 with identifier: 1878485
2026-01-28 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69ae6029-c977-530f-b71a-413c2adb65f2 with identifier: 1878485
2026-01-28 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'tiguan', 'trim': 'sport 2.0 tdi 110kw (150cv) dsg', 'title': 'volkswagen tiguan sport 2.0 tdi 110kw (150cv) dsg', 'price': 0, 'odometer': 219716, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-12', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 131, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '69ae6029-c977-530f-b71a-413c2adb65f2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ae6029-c977-530f-b71a-413c2adb65f2/69ae6029-c977-530f-b71a-413c2adb65f2_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 427317}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'volkswagen tiguan', 'sanitized_make': 'volkswagen', 'odometer_in_km': 219716}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '69ae6029-c977-530f-b71a-413c2adb65f2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen tiguan',
     'model': 'tiguan',
     'odometer': 219716,
     'odometer_in_km': 219716,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ae6029-c977-530f-b71a-413c2adb65f2/69ae6029-c977-530f-b71a-413c2adb65f2_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 427317,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-12',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen tiguan sport 2.0 tdi 110kw (150cv) dsg',
     'transmission': 'manual',
     'trim': 'sport 2.0 tdi 110kw (150cv) dsg',
     'vin': None,
     'year': 2019}
2026-01-28 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 69ae6029-c977-530f-b71a-413c2adb65f2 spider: ayvens.es
2026-01-28 20:03:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 69ae6029-c977-530f-b71a-413c2adb65f2 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'tiguan', 'trim': 'sport 2.0 tdi 110kw (150cv) dsg', 'title': 'volkswagen tiguan sport 2.0 tdi 110kw (150cv) dsg', 'price': 0, 'odometer': 219716, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-12', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 131, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '69ae6029-c977-530f-b71a-413c2adb65f2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ae6029-c977-530f-b71a-413c2adb65f2/69ae6029-c977-530f-b71a-413c2adb65f2_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 427317}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'volkswagen tiguan', 'sanitized_make': 'volkswagen', 'odometer_in_km': 219716}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '69ae6029-c977-530f-b71a-413c2adb65f2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen tiguan',
     'model': 'tiguan',
     'odometer': 219716,
     'odometer_in_km': 219716,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ae6029-c977-530f-b71a-413c2adb65f2/69ae6029-c977-530f-b71a-413c2adb65f2_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 427317,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-12',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen tiguan sport 2.0 tdi 110kw (150cv) dsg',
     'transmission': 'manual',
     'trim': 'sport 2.0 tdi 110kw (150cv) dsg',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '69ae6029-c977-530f-b71a-413c2adb65f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 219716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ae6029-c977-530f-b71a-413c2adb65f2/69ae6029-c977-530f-b71a-413c2adb65f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/69958a3d96ab4e038614a6d60ee75736/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Sport 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878485%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [ayvens.es] INFO: Saving data for 1878485: {'created_time': 1769630581.633123, 'last_price_update_time': 1769630581.633134, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878485') HTTP/1.1" 204 0
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912ad50>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33edc02e-f832-564e-bfa9-71e230ad9173/33edc02e-f832-564e-bfa9-71e230ad9173_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F981%252Fa8d2e01a90454a8ab33c3f3c5c7297fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/981/a8d2e01a90454a8ab33c3f3c5c7297fd/images/large/1.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33edc02e-f832-564e-bfa9-71e230ad9173
2026-01-28 20:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33edc02e-f832-564e-bfa9-71e230ad9173, skipping ID generation
2026-01-28 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33edc02e-f832-564e-bfa9-71e230ad9173 with scrape type 1
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 33edc02e-f832-564e-bfa9-71e230ad9173 from tracking dictionaries
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33edc02e-f832-564e-bfa9-71e230ad9173 sending to next pipeline
2026-01-28 20:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33edc02e-f832-564e-bfa9-71e230ad9173, identifier: 1878486
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/59fd24fff5c8481bbca5932f7dab1b72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:02 [ayvens.es] INFO: Found listing with ID: 1878494
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878494%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [ayvens.es] INFO: Scrape type for 1878494: 1
2026-01-28 20:03:02 [ayvens.es] INFO: Extracting data for car ID: 1878494
2026-01-28 20:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ca6dfe-d2bc-54d0-95ca-8819ca45074a with identifier: 1878494
2026-01-28 20:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ca6dfe-d2bc-54d0-95ca-8819ca45074a with scrape type 1
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 02ca6dfe-d2bc-54d0-95ca-8819ca45074a
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F117%252F4290b7df73104e0b926e5c127e8a49fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/117/4290b7df73104e0b926e5c127e8a49fe/images/large/1.jpg not downloaded yet
2026-01-28 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33edc02e-f832-564e-bfa9-71e230ad9173 with identifier: 1878486
2026-01-28 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33edc02e-f832-564e-bfa9-71e230ad9173 with identifier: 1878486
2026-01-28 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2026-01-28 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 33edc02e-f832-564e-bfa9-71e230ad9173 spider: ayvens.es
2026-01-28 20:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 33edc02e-f832-564e-bfa9-71e230ad9173 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '33edc02e-f832-564e-bfa9-71e230ad9173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 52635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33edc02e-f832-564e-bfa9-71e230ad9173/33edc02e-f832-564e-bfa9-71e230ad9173_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/981/a8d2e01a90454a8ab33c3f3c5c7297fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Kombi 1.5 TDCi 88kW Trend 230 L2 (M1)',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 88kW Trend 230 L2 (M1)',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878486%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [ayvens.es] INFO: Saving data for 1878486: {'created_time': 1769630582.383469, 'last_price_update_time': 1769630582.383482, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878486') HTTP/1.1" 204 0
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/180/950eacf253b647289d9f5d2e232a33b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9008b90>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770/7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F778%252F7806372dfa384c5d8cf1ecb727bf6bab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/778/7806372dfa384c5d8cf1ecb727bf6bab/images/large/1.jpg saved to cache
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770
2026-01-28 20:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770, skipping ID generation
2026-01-28 20:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 with scrape type 1
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 from tracking dictionaries
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 sending to next pipeline
2026-01-28 20:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770, identifier: 1878487
2026-01-28 20:03:02 [ayvens.es] INFO: Found listing with ID: 1878495
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878495%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [ayvens.es] INFO: Scrape type for 1878495: 1
2026-01-28 20:03:02 [ayvens.es] INFO: Extracting data for car ID: 1878495
2026-01-28 20:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da55e106-d6ac-55dc-ae75-415ee8baf931 with identifier: 1878495
2026-01-28 20:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da55e106-d6ac-55dc-ae75-415ee8baf931 with scrape type 1
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da55e106-d6ac-55dc-ae75-415ee8baf931
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fbc673ac1ad5145ecb0b270c63f4ad148%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg not downloaded yet
2026-01-28 20:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 with identifier: 1878487
2026-01-28 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 with identifier: 1878487
2026-01-28 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-28 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 spider: ayvens.es
2026-01-28 20:03:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 131436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770/7ce64b84-2cf0-54a6-bddf-5a4e3a8c1770_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/778/7806372dfa384c5d8cf1ecb727bf6bab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) S/S Edition Plus L',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) S/S Edition Plus L',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878487%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [ayvens.es] INFO: Saving data for 1878487: {'created_time': 1769630583.245105, 'last_price_update_time': 1769630583.245115, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878487') HTTP/1.1" 204 0
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/482/f0a058b3229a4deba9778ef6e017ba8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca2642d0>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bad3dd1e-3194-5266-a4a7-f829cb0732a5/bad3dd1e-3194-5266-a4a7-f829cb0732a5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F59fd24fff5c8481bbca5932f7dab1b72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/59fd24fff5c8481bbca5932f7dab1b72/images/large/1.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bad3dd1e-3194-5266-a4a7-f829cb0732a5
2026-01-28 20:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bad3dd1e-3194-5266-a4a7-f829cb0732a5, skipping ID generation
2026-01-28 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bad3dd1e-3194-5266-a4a7-f829cb0732a5 with scrape type 1
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bad3dd1e-3194-5266-a4a7-f829cb0732a5 from tracking dictionaries
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bad3dd1e-3194-5266-a4a7-f829cb0732a5 sending to next pipeline
2026-01-28 20:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bad3dd1e-3194-5266-a4a7-f829cb0732a5, identifier: 1878488
2026-01-28 20:03:03 [ayvens.es] INFO: Found listing with ID: 1878496
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878496%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [ayvens.es] INFO: Scrape type for 1878496: 1
2026-01-28 20:03:03 [ayvens.es] INFO: Extracting data for car ID: 1878496
2026-01-28 20:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29bb6db7-3858-556b-9de5-03d489bb8301 with identifier: 1878496
2026-01-28 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29bb6db7-3858-556b-9de5-03d489bb8301 with scrape type 1
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29bb6db7-3858-556b-9de5-03d489bb8301
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F923%252F05ab27edf3944a1c80be8f6a96c38c35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/923/05ab27edf3944a1c80be8f6a96c38c35/images/large/1.jpg not downloaded yet
2026-01-28 20:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bad3dd1e-3194-5266-a4a7-f829cb0732a5 with identifier: 1878488
2026-01-28 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bad3dd1e-3194-5266-a4a7-f829cb0732a5 with identifier: 1878488
2026-01-28 20:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bad3dd1e-3194-5266-a4a7-f829cb0732a5 with identifier: 1878488 to the API
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/59fd24fff5c8481bbca5932f7dab1b72/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bad3dd1e-3194-5266-a4a7-f829cb0732a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 31089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bad3dd1e-3194-5266-a4a7-f829cb0732a5/bad3dd1e-3194-5266-a4a7-f829cb0732a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/59fd24fff5c8481bbca5932f7dab1b72/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878488%27 HTTP/1.1" 200 None
2026-01-28 20:03:04 [ayvens.es] INFO: Saving data for 1878488: {'created_time': 1769630584.155994, 'last_price_update_time': 1769630584.156004, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878488') HTTP/1.1" 204 0
2026-01-28 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/807/6747afa71f2146b99e69c6d7344d2f34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1e7a50>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcfd636-c35e-5d65-9ce5-4d7f403891ef/afcfd636-c35e-5d65-9ce5-4d7f403891ef_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F180%252F950eacf253b647289d9f5d2e232a33b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/180/950eacf253b647289d9f5d2e232a33b3/images/large/1.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afcfd636-c35e-5d65-9ce5-4d7f403891ef
2026-01-28 20:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afcfd636-c35e-5d65-9ce5-4d7f403891ef, skipping ID generation
2026-01-28 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcfd636-c35e-5d65-9ce5-4d7f403891ef with scrape type 1
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item afcfd636-c35e-5d65-9ce5-4d7f403891ef from tracking dictionaries
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afcfd636-c35e-5d65-9ce5-4d7f403891ef sending to next pipeline
2026-01-28 20:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: afcfd636-c35e-5d65-9ce5-4d7f403891ef, identifier: 1878489
2026-01-28 20:03:04 [ayvens.es] INFO: Found listing with ID: 1878497
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878497%27 HTTP/1.1" 200 None
2026-01-28 20:03:04 [ayvens.es] INFO: Scrape type for 1878497: 1
2026-01-28 20:03:04 [ayvens.es] INFO: Extracting data for car ID: 1878497
2026-01-28 20:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce88c37f-0eb6-527d-9c9a-93be2331db27 with identifier: 1878497
2026-01-28 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce88c37f-0eb6-527d-9c9a-93be2331db27 with scrape type 1
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce88c37f-0eb6-527d-9c9a-93be2331db27
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F125%252F435a7dd3d9624434a8f94002d39d9dfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/125/435a7dd3d9624434a8f94002d39d9dfe/images/large/1.jpg not downloaded yet
2026-01-28 20:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: afcfd636-c35e-5d65-9ce5-4d7f403891ef with identifier: 1878489
2026-01-28 20:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: afcfd636-c35e-5d65-9ce5-4d7f403891ef with identifier: 1878489
2026-01-28 20:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: afcfd636-c35e-5d65-9ce5-4d7f403891ef with identifier: 1878489 to the API
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/180/950eacf253b647289d9f5d2e232a33b3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'afcfd636-c35e-5d65-9ce5-4d7f403891ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 74680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcfd636-c35e-5d65-9ce5-4d7f403891ef/afcfd636-c35e-5d65-9ce5-4d7f403891ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/180/950eacf253b647289d9f5d2e232a33b3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878489%27 HTTP/1.1" 200 None
2026-01-28 20:03:05 [ayvens.es] INFO: Saving data for 1878489: {'created_time': 1769630585.176719, 'last_price_update_time': 1769630585.176732, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878489') HTTP/1.1" 204 0
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1fe150>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264/a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252Ff0a058b3229a4deba9778ef6e017ba8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/f0a058b3229a4deba9778ef6e017ba8b/images/large/1.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264
2026-01-28 20:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264, skipping ID generation
2026-01-28 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 with scrape type 1
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 from tracking dictionaries
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 sending to next pipeline
2026-01-28 20:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264, identifier: 1878490
2026-01-28 20:03:05 [ayvens.es] INFO: Found listing with ID: 1878498
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878498%27 HTTP/1.1" 200 None
2026-01-28 20:03:05 [ayvens.es] INFO: Scrape type for 1878498: 1
2026-01-28 20:03:05 [ayvens.es] INFO: Extracting data for car ID: 1878498
2026-01-28 20:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d7a743-fa11-5e8e-80c3-93699fa06415 with identifier: 1878498
2026-01-28 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d7a743-fa11-5e8e-80c3-93699fa06415 with scrape type 1
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2d7a743-fa11-5e8e-80c3-93699fa06415
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F234%252Ffe8ad5f441954d8c8d7d76c22ef69c17%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/234/fe8ad5f441954d8c8d7d76c22ef69c17/images/large/1.jpg not downloaded yet
2026-01-28 20:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 with identifier: 1878490
2026-01-28 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 with identifier: 1878490
2026-01-28 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169032 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169032
2026-01-28 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 spider: ayvens.es
2026-01-28 20:03:05 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264 due to rule: high_mileage_for_country.json, error: 169032 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169032
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 169032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264/a7b4b7b0-ee2c-59a8-bc68-495f0fcbe264_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/482/f0a058b3229a4deba9778ef6e017ba8b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Tiguan 2.0 TDI 90kW (122CV)',
 'transmission': 'manual',
 'trim': 'Tiguan 2.0 TDI 90kW (122CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878490%27 HTTP/1.1" 200 None
2026-01-28 20:03:05 [ayvens.es] INFO: Saving data for 1878490: {'created_time': 1769630585.861028, 'last_price_update_time': 1769630585.861037, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878490') HTTP/1.1" 204 0
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/841/a91385da07934d078b2e19a1e4a011b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca21dc50>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa39364-9b56-5203-b0ef-b4dbda3a90aa/0aa39364-9b56-5203-b0ef-b4dbda3a90aa_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F807%252F6747afa71f2146b99e69c6d7344d2f34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/807/6747afa71f2146b99e69c6d7344d2f34/images/large/1.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0aa39364-9b56-5203-b0ef-b4dbda3a90aa
2026-01-28 20:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0aa39364-9b56-5203-b0ef-b4dbda3a90aa, skipping ID generation
2026-01-28 20:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa39364-9b56-5203-b0ef-b4dbda3a90aa with scrape type 1
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0aa39364-9b56-5203-b0ef-b4dbda3a90aa from tracking dictionaries
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0aa39364-9b56-5203-b0ef-b4dbda3a90aa sending to next pipeline
2026-01-28 20:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0aa39364-9b56-5203-b0ef-b4dbda3a90aa, identifier: 1878491
2026-01-28 20:03:06 [ayvens.es] INFO: Found listing with ID: 1878499
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878499%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [ayvens.es] INFO: Scrape type for 1878499: 1
2026-01-28 20:03:06 [ayvens.es] INFO: Extracting data for car ID: 1878499
2026-01-28 20:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42b098e-bdd0-573d-83ec-c5d149aa6b00 with identifier: 1878499
2026-01-28 20:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42b098e-bdd0-573d-83ec-c5d149aa6b00 with scrape type 1
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e42b098e-bdd0-573d-83ec-c5d149aa6b00
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F251%252Fa728b7fb3a794d4fbd70ecf6f5734dab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/251/a728b7fb3a794d4fbd70ecf6f5734dab/images/large/1.jpg not downloaded yet
2026-01-28 20:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0aa39364-9b56-5203-b0ef-b4dbda3a90aa with identifier: 1878491
2026-01-28 20:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0aa39364-9b56-5203-b0ef-b4dbda3a90aa with identifier: 1878491
2026-01-28 20:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0aa39364-9b56-5203-b0ef-b4dbda3a90aa with identifier: 1878491 to the API
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/807/6747afa71f2146b99e69c6d7344d2f34/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0aa39364-9b56-5203-b0ef-b4dbda3a90aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 78229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa39364-9b56-5203-b0ef-b4dbda3a90aa/0aa39364-9b56-5203-b0ef-b4dbda3a90aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/807/6747afa71f2146b99e69c6d7344d2f34/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 EcoTSI 70kW (95CV) Reference Plus',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI 70kW (95CV) Reference Plus',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878491%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [ayvens.es] INFO: Saving data for 1878491: {'created_time': 1769630586.701805, 'last_price_update_time': 1769630586.701817, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878491') HTTP/1.1" 204 0
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/849/965775793ac142dc87dcd1771f996de4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [ayvens.es] INFO: Found listing with ID: 1878500
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878500%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [ayvens.es] INFO: Scrape type for 1878500: 1
2026-01-28 20:03:06 [ayvens.es] INFO: Extracting data for car ID: 1878500
2026-01-28 20:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2bb3526-b45e-55d4-bfc1-767198a43e4e with identifier: 1878500
2026-01-28 20:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bb3526-b45e-55d4-bfc1-767198a43e4e with scrape type 1
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e2bb3526-b45e-55d4-bfc1-767198a43e4e
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252Fdf8a843298084e18949f81d52b687780%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/df8a843298084e18949f81d52b687780/images/large/1.jpg not downloaded yet
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fc69d0>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9/7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F841%252Fa91385da07934d078b2e19a1e4a011b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/841/a91385da07934d078b2e19a1e4a011b3/images/large/1.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9
2026-01-28 20:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9, skipping ID generation
2026-01-28 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 with scrape type 1
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 from tracking dictionaries
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 sending to next pipeline
2026-01-28 20:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9, identifier: 1878493
2026-01-28 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/923/05ab27edf3944a1c80be8f6a96c38c35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:07 [ayvens.es] INFO: Found listing with ID: 1878501
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878501%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [ayvens.es] INFO: Scrape type for 1878501: 1
2026-01-28 20:03:07 [ayvens.es] INFO: Extracting data for car ID: 1878501
2026-01-28 20:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a8bd13-d098-5174-83da-6c40b49ad668 with identifier: 1878501
2026-01-28 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a8bd13-d098-5174-83da-6c40b49ad668 with scrape type 1
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 03a8bd13-d098-5174-83da-6c40b49ad668
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252Fbdb5da82774b4dc9a0e29354563a5faa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg not downloaded yet
2026-01-28 20:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 with identifier: 1878493
2026-01-28 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 with identifier: 1878493
2026-01-28 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137108 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137108
2026-01-28 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 spider: ayvens.es
2026-01-28 20:03:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9 due to rule: high_mileage_for_make.json, error: 137108 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137108
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 137108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9/7388cbe6-b80d-5e18-b797-2dd4d4f8f7f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/841/a91385da07934d078b2e19a1e4a011b3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878493%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [ayvens.es] INFO: Saving data for 1878493: {'created_time': 1769630587.693506, 'last_price_update_time': 1769630587.693516, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878493') HTTP/1.1" 204 0
2026-01-28 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/117/4290b7df73104e0b926e5c127e8a49fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:07 [ayvens.es] INFO: Found listing with ID: 1878502
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878502%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [ayvens.es] INFO: Scrape type for 1878502: 1
2026-01-28 20:03:07 [ayvens.es] INFO: Extracting data for car ID: 1878502
2026-01-28 20:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f77f2c-196b-525a-8ac1-3b8c247052b9 with identifier: 1878502
2026-01-28 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f77f2c-196b-525a-8ac1-3b8c247052b9 with scrape type 1
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c6f77f2c-196b-525a-8ac1-3b8c247052b9
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F164%252F42b50d24eda4483aa105c5a18fb0da29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/164/42b50d24eda4483aa105c5a18fb0da29/images/large/1.jpg not downloaded yet
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c90127d0>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa694974-e86f-5686-8782-fb3f799e8e9f/fa694974-e86f-5686-8782-fb3f799e8e9f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F965775793ac142dc87dcd1771f996de4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/965775793ac142dc87dcd1771f996de4/images/large/1.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa694974-e86f-5686-8782-fb3f799e8e9f
2026-01-28 20:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa694974-e86f-5686-8782-fb3f799e8e9f, skipping ID generation
2026-01-28 20:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa694974-e86f-5686-8782-fb3f799e8e9f with scrape type 1
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fa694974-e86f-5686-8782-fb3f799e8e9f from tracking dictionaries
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa694974-e86f-5686-8782-fb3f799e8e9f sending to next pipeline
2026-01-28 20:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fa694974-e86f-5686-8782-fb3f799e8e9f, identifier: 1878492
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca92b7d0>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29bb6db7-3858-556b-9de5-03d489bb8301/29bb6db7-3858-556b-9de5-03d489bb8301_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F923%252F05ab27edf3944a1c80be8f6a96c38c35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/923/05ab27edf3944a1c80be8f6a96c38c35/images/large/1.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29bb6db7-3858-556b-9de5-03d489bb8301
2026-01-28 20:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29bb6db7-3858-556b-9de5-03d489bb8301, skipping ID generation
2026-01-28 20:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29bb6db7-3858-556b-9de5-03d489bb8301 with scrape type 1
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 29bb6db7-3858-556b-9de5-03d489bb8301 from tracking dictionaries
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29bb6db7-3858-556b-9de5-03d489bb8301 sending to next pipeline
2026-01-28 20:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29bb6db7-3858-556b-9de5-03d489bb8301, identifier: 1878496
2026-01-28 20:03:08 [ayvens.es] INFO: Found listing with ID: 1878503
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878503%27 HTTP/1.1" 200 None
2026-01-28 20:03:08 [ayvens.es] INFO: Scrape type for 1878503: 1
2026-01-28 20:03:08 [ayvens.es] INFO: Extracting data for car ID: 1878503
2026-01-28 20:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6286c613-fce8-56e7-8f9b-492dcc869ea4 with identifier: 1878503
2026-01-28 20:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6286c613-fce8-56e7-8f9b-492dcc869ea4 with scrape type 1
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6286c613-fce8-56e7-8f9b-492dcc869ea4
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252Fea39361ef72042e8be9bc3ed33a77d09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/ea39361ef72042e8be9bc3ed33a77d09/images/large/1.jpg not downloaded yet
2026-01-28 20:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fa694974-e86f-5686-8782-fb3f799e8e9f with identifier: 1878492
2026-01-28 20:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fa694974-e86f-5686-8782-fb3f799e8e9f with identifier: 1878492
2026-01-28 20:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fa694974-e86f-5686-8782-fb3f799e8e9f with identifier: 1878492 to the API
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/849/965775793ac142dc87dcd1771f996de4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa694974-e86f-5686-8782-fb3f799e8e9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 122544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa694974-e86f-5686-8782-fb3f799e8e9f/fa694974-e86f-5686-8782-fb3f799e8e9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/849/965775793ac142dc87dcd1771f996de4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK S line 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'S line 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2022}
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878492%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [ayvens.es] INFO: Saving data for 1878492: {'created_time': 1769630589.091976, 'last_price_update_time': 1769630589.09199, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878492') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29bb6db7-3858-556b-9de5-03d489bb8301 with identifier: 1878496
2026-01-28 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29bb6db7-3858-556b-9de5-03d489bb8301 with identifier: 1878496
2026-01-28 20:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29bb6db7-3858-556b-9de5-03d489bb8301 with identifier: 1878496 to the API
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/923/05ab27edf3944a1c80be8f6a96c38c35/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '29bb6db7-3858-556b-9de5-03d489bb8301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 102338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29bb6db7-3858-556b-9de5-03d489bb8301/29bb6db7-3858-556b-9de5-03d489bb8301_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/923/05ab27edf3944a1c80be8f6a96c38c35/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.6 TDI 85kW St&Sp Style Edit. Nav Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW St&Sp Style Edit. Nav Eco',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878496%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [ayvens.es] INFO: Saving data for 1878496: {'created_time': 1769630589.689479, 'last_price_update_time': 1769630589.689494, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878496') HTTP/1.1" 204 0
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/125/435a7dd3d9624434a8f94002d39d9dfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/234/fe8ad5f441954d8c8d7d76c22ef69c17/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [ayvens.es] INFO: Found listing with ID: 1878504
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878504%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [ayvens.es] INFO: Scrape type for 1878504: 1
2026-01-28 20:03:09 [ayvens.es] INFO: Extracting data for car ID: 1878504
2026-01-28 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5063688-befc-5cba-b4e7-809de434e172 with identifier: 1878504
2026-01-28 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5063688-befc-5cba-b4e7-809de434e172 with scrape type 1
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a5063688-befc-5cba-b4e7-809de434e172
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F8dde209148e84dfeb7019f997f57db66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/8dde209148e84dfeb7019f997f57db66/images/large/1.jpg not downloaded yet
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/251/a728b7fb3a794d4fbd70ecf6f5734dab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca2a9990>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ca6dfe-d2bc-54d0-95ca-8819ca45074a/02ca6dfe-d2bc-54d0-95ca-8819ca45074a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F117%252F4290b7df73104e0b926e5c127e8a49fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/117/4290b7df73104e0b926e5c127e8a49fe/images/large/1.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02ca6dfe-d2bc-54d0-95ca-8819ca45074a
2026-01-28 20:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02ca6dfe-d2bc-54d0-95ca-8819ca45074a, skipping ID generation
2026-01-28 20:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ca6dfe-d2bc-54d0-95ca-8819ca45074a with scrape type 1
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 02ca6dfe-d2bc-54d0-95ca-8819ca45074a from tracking dictionaries
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02ca6dfe-d2bc-54d0-95ca-8819ca45074a sending to next pipeline
2026-01-28 20:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 02ca6dfe-d2bc-54d0-95ca-8819ca45074a, identifier: 1878494
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca24dd90>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da55e106-d6ac-55dc-ae75-415ee8baf931/da55e106-d6ac-55dc-ae75-415ee8baf931_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fbc673ac1ad5145ecb0b270c63f4ad148%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da55e106-d6ac-55dc-ae75-415ee8baf931
2026-01-28 20:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da55e106-d6ac-55dc-ae75-415ee8baf931, skipping ID generation
2026-01-28 20:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da55e106-d6ac-55dc-ae75-415ee8baf931 with scrape type 1
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item da55e106-d6ac-55dc-ae75-415ee8baf931 from tracking dictionaries
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da55e106-d6ac-55dc-ae75-415ee8baf931 sending to next pipeline
2026-01-28 20:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da55e106-d6ac-55dc-ae75-415ee8baf931, identifier: 1878495
2026-01-28 20:03:10 [ayvens.es] INFO: Found listing with ID: 1878505
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878505%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [ayvens.es] INFO: Scrape type for 1878505: 1
2026-01-28 20:03:10 [ayvens.es] INFO: Extracting data for car ID: 1878505
2026-01-28 20:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8800f2e3-6547-55d9-84a1-df8978329e58 with identifier: 1878505
2026-01-28 20:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8800f2e3-6547-55d9-84a1-df8978329e58 with scrape type 1
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8800f2e3-6547-55d9-84a1-df8978329e58
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252Fe48f9c286a46404bbfd3ff72914b5489%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/e48f9c286a46404bbfd3ff72914b5489/images/large/1.jpg not downloaded yet
2026-01-28 20:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 02ca6dfe-d2bc-54d0-95ca-8819ca45074a with identifier: 1878494
2026-01-28 20:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 02ca6dfe-d2bc-54d0-95ca-8819ca45074a with identifier: 1878494
2026-01-28 20:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 02ca6dfe-d2bc-54d0-95ca-8819ca45074a with identifier: 1878494 to the API
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/117/4290b7df73104e0b926e5c127e8a49fe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '02ca6dfe-d2bc-54d0-95ca-8819ca45074a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 100654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ca6dfe-d2bc-54d0-95ca-8819ca45074a/02ca6dfe-d2bc-54d0-95ca-8819ca45074a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/117/4290b7df73104e0b926e5c127e8a49fe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878494%27 HTTP/1.1" 200 None
2026-01-28 20:03:11 [ayvens.es] INFO: Saving data for 1878494: {'created_time': 1769630591.120717, 'last_price_update_time': 1769630591.120731, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878494') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da55e106-d6ac-55dc-ae75-415ee8baf931 with identifier: 1878495
2026-01-28 20:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da55e106-d6ac-55dc-ae75-415ee8baf931 with identifier: 1878495
2026-01-28 20:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 120132, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'da55e106-d6ac-55dc-ae75-415ee8baf931', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da55e106-d6ac-55dc-ae75-415ee8baf931/da55e106-d6ac-55dc-ae75-415ee8baf931_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 527916}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 120132}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'da55e106-d6ac-55dc-ae75-415ee8baf931',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 120132,
     'odometer_in_km': 120132,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da55e106-d6ac-55dc-ae75-415ee8baf931/da55e106-d6ac-55dc-ae75-415ee8baf931_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 527916,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
2026-01-28 20:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: da55e106-d6ac-55dc-ae75-415ee8baf931 spider: ayvens.es
2026-01-28 20:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: da55e106-d6ac-55dc-ae75-415ee8baf931 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 120132, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'da55e106-d6ac-55dc-ae75-415ee8baf931', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da55e106-d6ac-55dc-ae75-415ee8baf931/da55e106-d6ac-55dc-ae75-415ee8baf931_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 527916}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 120132}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'da55e106-d6ac-55dc-ae75-415ee8baf931',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 120132,
     'odometer_in_km': 120132,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da55e106-d6ac-55dc-ae75-415ee8baf931/da55e106-d6ac-55dc-ae75-415ee8baf931_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 527916,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'da55e106-d6ac-55dc-ae75-415ee8baf931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 120132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da55e106-d6ac-55dc-ae75-415ee8baf931/da55e106-d6ac-55dc-ae75-415ee8baf931_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/bc673ac1ad5145ecb0b270c63f4ad148/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878495%27 HTTP/1.1" 200 None
2026-01-28 20:03:11 [ayvens.es] INFO: Saving data for 1878495: {'created_time': 1769630591.402744, 'last_price_update_time': 1769630591.402755, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878495') HTTP/1.1" 204 0
2026-01-28 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/011/df8a843298084e18949f81d52b687780/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:11 [ayvens.es] INFO: Found listing with ID: 1878506
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878506%27 HTTP/1.1" 200 None
2026-01-28 20:03:11 [ayvens.es] INFO: Scrape type for 1878506: 1
2026-01-28 20:03:11 [ayvens.es] INFO: Extracting data for car ID: 1878506
2026-01-28 20:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 779fb26a-6dfa-5009-ba40-61bd24efae9f with identifier: 1878506
2026-01-28 20:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 779fb26a-6dfa-5009-ba40-61bd24efae9f with scrape type 1
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 779fb26a-6dfa-5009-ba40-61bd24efae9f
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F077e8dafb62c4950a81556151dcff5a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/077e8dafb62c4950a81556151dcff5a9/images/large/1.jpg not downloaded yet
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fe9bd0>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce88c37f-0eb6-527d-9c9a-93be2331db27/ce88c37f-0eb6-527d-9c9a-93be2331db27_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F125%252F435a7dd3d9624434a8f94002d39d9dfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/125/435a7dd3d9624434a8f94002d39d9dfe/images/large/1.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce88c37f-0eb6-527d-9c9a-93be2331db27
2026-01-28 20:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce88c37f-0eb6-527d-9c9a-93be2331db27, skipping ID generation
2026-01-28 20:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce88c37f-0eb6-527d-9c9a-93be2331db27 with scrape type 1
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ce88c37f-0eb6-527d-9c9a-93be2331db27 from tracking dictionaries
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce88c37f-0eb6-527d-9c9a-93be2331db27 sending to next pipeline
2026-01-28 20:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce88c37f-0eb6-527d-9c9a-93be2331db27, identifier: 1878497
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca266e10>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2d7a743-fa11-5e8e-80c3-93699fa06415/f2d7a743-fa11-5e8e-80c3-93699fa06415_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F234%252Ffe8ad5f441954d8c8d7d76c22ef69c17%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/234/fe8ad5f441954d8c8d7d76c22ef69c17/images/large/1.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2d7a743-fa11-5e8e-80c3-93699fa06415
2026-01-28 20:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2d7a743-fa11-5e8e-80c3-93699fa06415, skipping ID generation
2026-01-28 20:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d7a743-fa11-5e8e-80c3-93699fa06415 with scrape type 1
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2d7a743-fa11-5e8e-80c3-93699fa06415 from tracking dictionaries
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2d7a743-fa11-5e8e-80c3-93699fa06415 sending to next pipeline
2026-01-28 20:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2d7a743-fa11-5e8e-80c3-93699fa06415, identifier: 1878498
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1fcf50>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e42b098e-bdd0-573d-83ec-c5d149aa6b00/e42b098e-bdd0-573d-83ec-c5d149aa6b00_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F251%252Fa728b7fb3a794d4fbd70ecf6f5734dab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/251/a728b7fb3a794d4fbd70ecf6f5734dab/images/large/1.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e42b098e-bdd0-573d-83ec-c5d149aa6b00
2026-01-28 20:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e42b098e-bdd0-573d-83ec-c5d149aa6b00, skipping ID generation
2026-01-28 20:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42b098e-bdd0-573d-83ec-c5d149aa6b00 with scrape type 1
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e42b098e-bdd0-573d-83ec-c5d149aa6b00 from tracking dictionaries
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e42b098e-bdd0-573d-83ec-c5d149aa6b00 sending to next pipeline
2026-01-28 20:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e42b098e-bdd0-573d-83ec-c5d149aa6b00, identifier: 1878499
2026-01-28 20:03:12 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 2 pages/min), scraped 92 items (at 33 items/min)
2026-01-28 20:03:12 [ayvens.es] INFO: Found listing with ID: 1878507
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878507%27 HTTP/1.1" 200 None
2026-01-28 20:03:12 [ayvens.es] INFO: Scrape type for 1878507: 1
2026-01-28 20:03:12 [ayvens.es] INFO: Extracting data for car ID: 1878507
2026-01-28 20:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6663b77-3647-5ebe-a4b0-c80a058b97dd with identifier: 1878507
2026-01-28 20:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6663b77-3647-5ebe-a4b0-c80a058b97dd with scrape type 1
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6663b77-3647-5ebe-a4b0-c80a058b97dd
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F092%252Fa83aac708e384c2e9810d4c7099d63d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/092/a83aac708e384c2e9810d4c7099d63d3/images/large/1.jpg not downloaded yet
2026-01-28 20:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce88c37f-0eb6-527d-9c9a-93be2331db27 with identifier: 1878497
2026-01-28 20:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce88c37f-0eb6-527d-9c9a-93be2331db27 with identifier: 1878497
2026-01-28 20:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce88c37f-0eb6-527d-9c9a-93be2331db27 with identifier: 1878497 to the API
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/125/435a7dd3d9624434a8f94002d39d9dfe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce88c37f-0eb6-527d-9c9a-93be2331db27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 61819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce88c37f-0eb6-527d-9c9a-93be2331db27/ce88c37f-0eb6-527d-9c9a-93be2331db27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/125/435a7dd3d9624434a8f94002d39d9dfe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.6 TDI 85kW (115CV) St&Sp Reference Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW (115CV) St&Sp Reference Eco',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878497%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [ayvens.es] INFO: Saving data for 1878497: {'created_time': 1769630593.295326, 'last_price_update_time': 1769630593.29534, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878497') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2d7a743-fa11-5e8e-80c3-93699fa06415 with identifier: 1878498
2026-01-28 20:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2d7a743-fa11-5e8e-80c3-93699fa06415 with identifier: 1878498
2026-01-28 20:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2d7a743-fa11-5e8e-80c3-93699fa06415 with identifier: 1878498 to the API
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/234/fe8ad5f441954d8c8d7d76c22ef69c17/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f2d7a743-fa11-5e8e-80c3-93699fa06415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 136618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2d7a743-fa11-5e8e-80c3-93699fa06415/f2d7a743-fa11-5e8e-80c3-93699fa06415_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/234/fe8ad5f441954d8c8d7d76c22ef69c17/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2018}
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878498%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [ayvens.es] INFO: Saving data for 1878498: {'created_time': 1769630593.692496, 'last_price_update_time': 1769630593.692505, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878498') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e42b098e-bdd0-573d-83ec-c5d149aa6b00 with identifier: 1878499
2026-01-28 20:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e42b098e-bdd0-573d-83ec-c5d149aa6b00 with identifier: 1878499
2026-01-28 20:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166351 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166351
2026-01-28 20:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e42b098e-bdd0-573d-83ec-c5d149aa6b00 spider: ayvens.es
2026-01-28 20:03:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e42b098e-bdd0-573d-83ec-c5d149aa6b00 due to rule: high_mileage_for_country.json, error: 166351 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166351
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e42b098e-bdd0-573d-83ec-c5d149aa6b00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 166351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e42b098e-bdd0-573d-83ec-c5d149aa6b00/e42b098e-bdd0-573d-83ec-c5d149aa6b00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/251/a728b7fb3a794d4fbd70ecf6f5734dab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2018}
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878499%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [ayvens.es] INFO: Saving data for 1878499: {'created_time': 1769630593.939397, 'last_price_update_time': 1769630593.939407, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878499') HTTP/1.1" 204 0
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [ayvens.es] INFO: Found listing with ID: 1878508
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878508%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [ayvens.es] INFO: Scrape type for 1878508: 1
2026-01-28 20:03:13 [ayvens.es] INFO: Extracting data for car ID: 1878508
2026-01-28 20:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f87305-3004-5deb-bb6b-5759528cebec with identifier: 1878508
2026-01-28 20:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f87305-3004-5deb-bb6b-5759528cebec with scrape type 1
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a2f87305-3004-5deb-bb6b-5759528cebec
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Ffaffd53203044595aafebf3a6688af8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg not downloaded yet
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca844110>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bb3526-b45e-55d4-bfc1-767198a43e4e/e2bb3526-b45e-55d4-bfc1-767198a43e4e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252Fdf8a843298084e18949f81d52b687780%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/df8a843298084e18949f81d52b687780/images/large/1.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2bb3526-b45e-55d4-bfc1-767198a43e4e
2026-01-28 20:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2bb3526-b45e-55d4-bfc1-767198a43e4e, skipping ID generation
2026-01-28 20:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bb3526-b45e-55d4-bfc1-767198a43e4e with scrape type 1
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e2bb3526-b45e-55d4-bfc1-767198a43e4e from tracking dictionaries
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2bb3526-b45e-55d4-bfc1-767198a43e4e sending to next pipeline
2026-01-28 20:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e2bb3526-b45e-55d4-bfc1-767198a43e4e, identifier: 1878500
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/164/42b50d24eda4483aa105c5a18fb0da29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:14 [ayvens.es] INFO: Found listing with ID: 1878509
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878509%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [ayvens.es] INFO: Scrape type for 1878509: 1
2026-01-28 20:03:14 [ayvens.es] INFO: Extracting data for car ID: 1878509
2026-01-28 20:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d791d3bf-51be-5603-9035-50acaf78b99d with identifier: 1878509
2026-01-28 20:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d791d3bf-51be-5603-9035-50acaf78b99d with scrape type 1
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d791d3bf-51be-5603-9035-50acaf78b99d
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F944a9f529293480e90f8aa5cf7bea07c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/944a9f529293480e90f8aa5cf7bea07c/images/large/1.jpg not downloaded yet
2026-01-28 20:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e2bb3526-b45e-55d4-bfc1-767198a43e4e with identifier: 1878500
2026-01-28 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e2bb3526-b45e-55d4-bfc1-767198a43e4e with identifier: 1878500
2026-01-28 20:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e2bb3526-b45e-55d4-bfc1-767198a43e4e with identifier: 1878500 to the API
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/011/df8a843298084e18949f81d52b687780/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e2bb3526-b45e-55d4-bfc1-767198a43e4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 81452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bb3526-b45e-55d4-bfc1-767198a43e4e/e2bb3526-b45e-55d4-bfc1-767198a43e4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/011/df8a843298084e18949f81d52b687780/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878500%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [ayvens.es] INFO: Saving data for 1878500: {'created_time': 1769630594.94444, 'last_price_update_time': 1769630594.944454, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878500') HTTP/1.1" 204 0
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/083/ea39361ef72042e8be9bc3ed33a77d09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:14 [ayvens.es] INFO: Found listing with ID: 1878510
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878510%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [ayvens.es] INFO: Scrape type for 1878510: 1
2026-01-28 20:03:15 [ayvens.es] INFO: Extracting data for car ID: 1878510
2026-01-28 20:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7dbcda-3660-5257-a662-de9bdae72589 with identifier: 1878510
2026-01-28 20:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7dbcda-3660-5257-a662-de9bdae72589 with scrape type 1
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c7dbcda-3660-5257-a662-de9bdae72589
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F854%252Fd028a58befff4d1da9686619bc8faffb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/854/d028a58befff4d1da9686619bc8faffb/images/large/1.jpg not downloaded yet
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1f5d90>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03a8bd13-d098-5174-83da-6c40b49ad668/03a8bd13-d098-5174-83da-6c40b49ad668_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252Fbdb5da82774b4dc9a0e29354563a5faa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03a8bd13-d098-5174-83da-6c40b49ad668
2026-01-28 20:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03a8bd13-d098-5174-83da-6c40b49ad668, skipping ID generation
2026-01-28 20:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a8bd13-d098-5174-83da-6c40b49ad668 with scrape type 1
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 03a8bd13-d098-5174-83da-6c40b49ad668 from tracking dictionaries
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03a8bd13-d098-5174-83da-6c40b49ad668 sending to next pipeline
2026-01-28 20:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 03a8bd13-d098-5174-83da-6c40b49ad668, identifier: 1878501
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca666410>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f77f2c-196b-525a-8ac1-3b8c247052b9/c6f77f2c-196b-525a-8ac1-3b8c247052b9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F164%252F42b50d24eda4483aa105c5a18fb0da29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/164/42b50d24eda4483aa105c5a18fb0da29/images/large/1.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6f77f2c-196b-525a-8ac1-3b8c247052b9
2026-01-28 20:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6f77f2c-196b-525a-8ac1-3b8c247052b9, skipping ID generation
2026-01-28 20:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f77f2c-196b-525a-8ac1-3b8c247052b9 with scrape type 1
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c6f77f2c-196b-525a-8ac1-3b8c247052b9 from tracking dictionaries
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6f77f2c-196b-525a-8ac1-3b8c247052b9 sending to next pipeline
2026-01-28 20:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c6f77f2c-196b-525a-8ac1-3b8c247052b9, identifier: 1878502
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/826/8dde209148e84dfeb7019f997f57db66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [ayvens.es] INFO: Found listing with ID: 1878511
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878511%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [ayvens.es] INFO: Scrape type for 1878511: 1
2026-01-28 20:03:16 [ayvens.es] INFO: Extracting data for car ID: 1878511
2026-01-28 20:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd9db909-a024-5d69-b85a-daf188be74e5 with identifier: 1878511
2026-01-28 20:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9db909-a024-5d69-b85a-daf188be74e5 with scrape type 1
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd9db909-a024-5d69-b85a-daf188be74e5
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F996%252Fe448ad49cb2f450298fce47eb9770967%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/996/e448ad49cb2f450298fce47eb9770967/images/large/1.jpg not downloaded yet
2026-01-28 20:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 03a8bd13-d098-5174-83da-6c40b49ad668 with identifier: 1878501
2026-01-28 20:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 03a8bd13-d098-5174-83da-6c40b49ad668 with identifier: 1878501
2026-01-28 20:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'plata', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'passat', 'trim': 'business 2.0 tdi 110kw (150cv)', 'title': 'volkswagen passat business 2.0 tdi 110kw (150cv)', 'price': 0, 'odometer': 231700, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-29', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '03a8bd13-d098-5174-83da-6c40b49ad668', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03a8bd13-d098-5174-83da-6c40b49ad668/03a8bd13-d098-5174-83da-6c40b49ad668_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 331654}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'volkswagen passat', 'sanitized_make': 'volkswagen', 'odometer_in_km': 231700}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'plata',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '03a8bd13-d098-5174-83da-6c40b49ad668',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen passat',
     'model': 'passat',
     'odometer': 231700,
     'odometer_in_km': 231700,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03a8bd13-d098-5174-83da-6c40b49ad668/03a8bd13-d098-5174-83da-6c40b49ad668_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 331654,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-29',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen passat business 2.0 tdi 110kw (150cv)',
     'transmission': 'manual',
     'trim': 'business 2.0 tdi 110kw (150cv)',
     'vin': None,
     'year': 2021}
2026-01-28 20:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 03a8bd13-d098-5174-83da-6c40b49ad668 spider: ayvens.es
2026-01-28 20:03:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 03a8bd13-d098-5174-83da-6c40b49ad668 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'plata', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'passat', 'trim': 'business 2.0 tdi 110kw (150cv)', 'title': 'volkswagen passat business 2.0 tdi 110kw (150cv)', 'price': 0, 'odometer': 231700, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-29', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '03a8bd13-d098-5174-83da-6c40b49ad668', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03a8bd13-d098-5174-83da-6c40b49ad668/03a8bd13-d098-5174-83da-6c40b49ad668_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 331654}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'volkswagen passat', 'sanitized_make': 'volkswagen', 'odometer_in_km': 231700}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'plata',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '03a8bd13-d098-5174-83da-6c40b49ad668',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen passat',
     'model': 'passat',
     'odometer': 231700,
     'odometer_in_km': 231700,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03a8bd13-d098-5174-83da-6c40b49ad668/03a8bd13-d098-5174-83da-6c40b49ad668_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 331654,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-29',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen passat business 2.0 tdi 110kw (150cv)',
     'transmission': 'manual',
     'trim': 'business 2.0 tdi 110kw (150cv)',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '03a8bd13-d098-5174-83da-6c40b49ad668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 231700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03a8bd13-d098-5174-83da-6c40b49ad668/03a8bd13-d098-5174-83da-6c40b49ad668_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/bdb5da82774b4dc9a0e29354563a5faa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878501%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [ayvens.es] INFO: Saving data for 1878501: {'created_time': 1769630596.2632, 'last_price_update_time': 1769630596.263209, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878501') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c6f77f2c-196b-525a-8ac1-3b8c247052b9 with identifier: 1878502
2026-01-28 20:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c6f77f2c-196b-525a-8ac1-3b8c247052b9 with identifier: 1878502
2026-01-28 20:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147382 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147382
2026-01-28 20:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: c6f77f2c-196b-525a-8ac1-3b8c247052b9 spider: ayvens.es
2026-01-28 20:03:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c6f77f2c-196b-525a-8ac1-3b8c247052b9 due to rule: high_mileage_for_make.json, error: 147382 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147382
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c6f77f2c-196b-525a-8ac1-3b8c247052b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 147382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f77f2c-196b-525a-8ac1-3b8c247052b9/c6f77f2c-196b-525a-8ac1-3b8c247052b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/164/42b50d24eda4483aa105c5a18fb0da29/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE BlueHDi 55kW (75CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE BlueHDi 55kW (75CV)',
 'vin': None,
 'year': 2018}
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878502%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [ayvens.es] INFO: Saving data for 1878502: {'created_time': 1769630596.600231, 'last_price_update_time': 1769630596.600242, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878502') HTTP/1.1" 204 0
2026-01-28 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/051/e48f9c286a46404bbfd3ff72914b5489/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:16 [ayvens.es] INFO: Found listing with ID: 1878512
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878512%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [ayvens.es] INFO: Scrape type for 1878512: 1
2026-01-28 20:03:16 [ayvens.es] INFO: Extracting data for car ID: 1878512
2026-01-28 20:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a785f4-f247-5707-b835-153b0fb3a389 with identifier: 1878512
2026-01-28 20:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a785f4-f247-5707-b835-153b0fb3a389 with scrape type 1
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99a785f4-f247-5707-b835-153b0fb3a389
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F835%252F8f1df8af5080473a8183ab28891ab2bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/835/8f1df8af5080473a8183ab28891ab2bb/images/large/1.jpg not downloaded yet
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912ea90>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6286c613-fce8-56e7-8f9b-492dcc869ea4/6286c613-fce8-56e7-8f9b-492dcc869ea4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252Fea39361ef72042e8be9bc3ed33a77d09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/ea39361ef72042e8be9bc3ed33a77d09/images/large/1.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6286c613-fce8-56e7-8f9b-492dcc869ea4
2026-01-28 20:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6286c613-fce8-56e7-8f9b-492dcc869ea4, skipping ID generation
2026-01-28 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6286c613-fce8-56e7-8f9b-492dcc869ea4 with scrape type 1
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6286c613-fce8-56e7-8f9b-492dcc869ea4 from tracking dictionaries
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6286c613-fce8-56e7-8f9b-492dcc869ea4 sending to next pipeline
2026-01-28 20:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6286c613-fce8-56e7-8f9b-492dcc869ea4, identifier: 1878503
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9168750>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5063688-befc-5cba-b4e7-809de434e172/a5063688-befc-5cba-b4e7-809de434e172_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F8dde209148e84dfeb7019f997f57db66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/8dde209148e84dfeb7019f997f57db66/images/large/1.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5063688-befc-5cba-b4e7-809de434e172
2026-01-28 20:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5063688-befc-5cba-b4e7-809de434e172, skipping ID generation
2026-01-28 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5063688-befc-5cba-b4e7-809de434e172 with scrape type 1
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a5063688-befc-5cba-b4e7-809de434e172 from tracking dictionaries
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5063688-befc-5cba-b4e7-809de434e172 sending to next pipeline
2026-01-28 20:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a5063688-befc-5cba-b4e7-809de434e172, identifier: 1878504
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/519/077e8dafb62c4950a81556151dcff5a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:17 [ayvens.es] INFO: Found listing with ID: 1878513
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878513%27 HTTP/1.1" 200 None
2026-01-28 20:03:17 [ayvens.es] INFO: Scrape type for 1878513: 1
2026-01-28 20:03:17 [ayvens.es] INFO: Extracting data for car ID: 1878513
2026-01-28 20:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29bc556d-922b-5aeb-af65-c086976f8f01 with identifier: 1878513
2026-01-28 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29bc556d-922b-5aeb-af65-c086976f8f01 with scrape type 1
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29bc556d-922b-5aeb-af65-c086976f8f01
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F081%252F8491843c347c4e0eb24472155c89086c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/081/8491843c347c4e0eb24472155c89086c/images/large/1.jpg not downloaded yet
2026-01-28 20:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6286c613-fce8-56e7-8f9b-492dcc869ea4 with identifier: 1878503
2026-01-28 20:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6286c613-fce8-56e7-8f9b-492dcc869ea4 with identifier: 1878503
2026-01-28 20:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6286c613-fce8-56e7-8f9b-492dcc869ea4 with identifier: 1878503 to the API
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/083/ea39361ef72042e8be9bc3ed33a77d09/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6286c613-fce8-56e7-8f9b-492dcc869ea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 63156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6286c613-fce8-56e7-8f9b-492dcc869ea4/6286c613-fce8-56e7-8f9b-492dcc869ea4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/083/ea39361ef72042e8be9bc3ed33a77d09/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 Turbo 74kW (100CV) Selective S/S',
 'transmission': 'manual',
 'trim': '1.4 Turbo 74kW (100CV) Selective S/S',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878503%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [ayvens.es] INFO: Saving data for 1878503: {'created_time': 1769630598.878008, 'last_price_update_time': 1769630598.87802, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878503') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a5063688-befc-5cba-b4e7-809de434e172 with identifier: 1878504
2026-01-28 20:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a5063688-befc-5cba-b4e7-809de434e172 with identifier: 1878504
2026-01-28 20:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a5063688-befc-5cba-b4e7-809de434e172 with identifier: 1878504 to the API
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/826/8dde209148e84dfeb7019f997f57db66/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a5063688-befc-5cba-b4e7-809de434e172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 131570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5063688-befc-5cba-b4e7-809de434e172/a5063688-befc-5cba-b4e7-809de434e172_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/826/8dde209148e84dfeb7019f997f57db66/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 Advanced 30 TDI 85kW (116CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 30 TDI 85kW (116CV) S tronic',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878504%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [ayvens.es] INFO: Saving data for 1878504: {'created_time': 1769630599.374386, 'last_price_update_time': 1769630599.374398, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878504') HTTP/1.1" 204 0
2026-01-28 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/092/a83aac708e384c2e9810d4c7099d63d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:19 [ayvens.es] INFO: Found listing with ID: 1878514
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878514%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [ayvens.es] INFO: Scrape type for 1878514: 1
2026-01-28 20:03:19 [ayvens.es] INFO: Extracting data for car ID: 1878514
2026-01-28 20:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e31b757-5ae4-57be-9712-f5f6369db485 with identifier: 1878514
2026-01-28 20:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e31b757-5ae4-57be-9712-f5f6369db485 with scrape type 1
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8e31b757-5ae4-57be-9712-f5f6369db485
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252F424152b10a324723a096f5f5e39db600%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/424152b10a324723a096f5f5e39db600/images/large/1.jpg not downloaded yet
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca20f8d0>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8800f2e3-6547-55d9-84a1-df8978329e58/8800f2e3-6547-55d9-84a1-df8978329e58_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252Fe48f9c286a46404bbfd3ff72914b5489%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/e48f9c286a46404bbfd3ff72914b5489/images/large/1.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8800f2e3-6547-55d9-84a1-df8978329e58
2026-01-28 20:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8800f2e3-6547-55d9-84a1-df8978329e58, skipping ID generation
2026-01-28 20:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8800f2e3-6547-55d9-84a1-df8978329e58 with scrape type 1
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8800f2e3-6547-55d9-84a1-df8978329e58 from tracking dictionaries
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8800f2e3-6547-55d9-84a1-df8978329e58 sending to next pipeline
2026-01-28 20:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8800f2e3-6547-55d9-84a1-df8978329e58, identifier: 1878505
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca674a50>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779fb26a-6dfa-5009-ba40-61bd24efae9f/779fb26a-6dfa-5009-ba40-61bd24efae9f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F077e8dafb62c4950a81556151dcff5a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/077e8dafb62c4950a81556151dcff5a9/images/large/1.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 779fb26a-6dfa-5009-ba40-61bd24efae9f
2026-01-28 20:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 779fb26a-6dfa-5009-ba40-61bd24efae9f, skipping ID generation
2026-01-28 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 779fb26a-6dfa-5009-ba40-61bd24efae9f with scrape type 1
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 779fb26a-6dfa-5009-ba40-61bd24efae9f from tracking dictionaries
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 779fb26a-6dfa-5009-ba40-61bd24efae9f sending to next pipeline
2026-01-28 20:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 779fb26a-6dfa-5009-ba40-61bd24efae9f, identifier: 1878506
2026-01-28 20:03:20 [ayvens.es] INFO: Found listing with ID: 1878515
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878515%27 HTTP/1.1" 200 None
2026-01-28 20:03:20 [ayvens.es] INFO: Scrape type for 1878515: 1
2026-01-28 20:03:20 [ayvens.es] INFO: Extracting data for car ID: 1878515
2026-01-28 20:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 307fb249-1159-5ac4-9a7e-3f34ac62813c with identifier: 1878515
2026-01-28 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 307fb249-1159-5ac4-9a7e-3f34ac62813c with scrape type 1
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 307fb249-1159-5ac4-9a7e-3f34ac62813c
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F1ab7da3c54a44171a6222901d2aa7702%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/1ab7da3c54a44171a6222901d2aa7702/images/large/1.jpg not downloaded yet
2026-01-28 20:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8800f2e3-6547-55d9-84a1-df8978329e58 with identifier: 1878505
2026-01-28 20:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8800f2e3-6547-55d9-84a1-df8978329e58 with identifier: 1878505
2026-01-28 20:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8800f2e3-6547-55d9-84a1-df8978329e58 with identifier: 1878505 to the API
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/051/e48f9c286a46404bbfd3ff72914b5489/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8800f2e3-6547-55d9-84a1-df8978329e58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 12986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8800f2e3-6547-55d9-84a1-df8978329e58/8800f2e3-6547-55d9-84a1-df8978329e58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/051/e48f9c286a46404bbfd3ff72914b5489/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) Plus',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) Plus',
 'vin': None,
 'year': 2024}
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878505%27 HTTP/1.1" 200 None
2026-01-28 20:03:20 [ayvens.es] INFO: Saving data for 1878505: {'created_time': 1769630600.988066, 'last_price_update_time': 1769630600.988079, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878505') HTTP/1.1" 204 0
2026-01-28 20:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 779fb26a-6dfa-5009-ba40-61bd24efae9f with identifier: 1878506
2026-01-28 20:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 779fb26a-6dfa-5009-ba40-61bd24efae9f with identifier: 1878506
2026-01-28 20:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 779fb26a-6dfa-5009-ba40-61bd24efae9f with identifier: 1878506 to the API
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/519/077e8dafb62c4950a81556151dcff5a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '779fb26a-6dfa-5009-ba40-61bd24efae9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 39678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779fb26a-6dfa-5009-ba40-61bd24efae9f/779fb26a-6dfa-5009-ba40-61bd24efae9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/077e8dafb62c4950a81556151dcff5a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878506%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [ayvens.es] INFO: Saving data for 1878506: {'created_time': 1769630601.429225, 'last_price_update_time': 1769630601.429239, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878506') HTTP/1.1" 204 0
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8bfdd0>
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f87305-3004-5deb-bb6b-5759528cebec/a2f87305-3004-5deb-bb6b-5759528cebec_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Ffaffd53203044595aafebf3a6688af8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg saved to cache
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2f87305-3004-5deb-bb6b-5759528cebec
2026-01-28 20:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2f87305-3004-5deb-bb6b-5759528cebec, skipping ID generation
2026-01-28 20:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f87305-3004-5deb-bb6b-5759528cebec with scrape type 1
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a2f87305-3004-5deb-bb6b-5759528cebec from tracking dictionaries
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2f87305-3004-5deb-bb6b-5759528cebec sending to next pipeline
2026-01-28 20:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a2f87305-3004-5deb-bb6b-5759528cebec, identifier: 1878508
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca674cd0>
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6663b77-3647-5ebe-a4b0-c80a058b97dd/f6663b77-3647-5ebe-a4b0-c80a058b97dd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F092%252Fa83aac708e384c2e9810d4c7099d63d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/092/a83aac708e384c2e9810d4c7099d63d3/images/large/1.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6663b77-3647-5ebe-a4b0-c80a058b97dd
2026-01-28 20:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6663b77-3647-5ebe-a4b0-c80a058b97dd, skipping ID generation
2026-01-28 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6663b77-3647-5ebe-a4b0-c80a058b97dd with scrape type 1
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f6663b77-3647-5ebe-a4b0-c80a058b97dd from tracking dictionaries
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6663b77-3647-5ebe-a4b0-c80a058b97dd sending to next pipeline
2026-01-28 20:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6663b77-3647-5ebe-a4b0-c80a058b97dd, identifier: 1878507
2026-01-28 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/651/944a9f529293480e90f8aa5cf7bea07c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:22 [ayvens.es] INFO: Found listing with ID: 1878516
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878516%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [ayvens.es] INFO: Scrape type for 1878516: 1
2026-01-28 20:03:22 [ayvens.es] INFO: Extracting data for car ID: 1878516
2026-01-28 20:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 188f0868-ada2-5f74-b11d-83cd462ffdbc with identifier: 1878516
2026-01-28 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 188f0868-ada2-5f74-b11d-83cd462ffdbc with scrape type 1
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 188f0868-ada2-5f74-b11d-83cd462ffdbc
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F699%252F9767b4b85c53495dade0b24790d3f1e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg not downloaded yet
2026-01-28 20:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a2f87305-3004-5deb-bb6b-5759528cebec with identifier: 1878508
2026-01-28 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a2f87305-3004-5deb-bb6b-5759528cebec with identifier: 1878508
2026-01-28 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 55120, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-11', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a2f87305-3004-5deb-bb6b-5759528cebec', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f87305-3004-5deb-bb6b-5759528cebec/a2f87305-3004-5deb-bb6b-5759528cebec_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301672}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 55120}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'a2f87305-3004-5deb-bb6b-5759528cebec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 55120,
     'odometer_in_km': 55120,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f87305-3004-5deb-bb6b-5759528cebec/a2f87305-3004-5deb-bb6b-5759528cebec_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301672,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
2026-01-28 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a2f87305-3004-5deb-bb6b-5759528cebec spider: ayvens.es
2026-01-28 20:03:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a2f87305-3004-5deb-bb6b-5759528cebec due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 55120, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-11', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a2f87305-3004-5deb-bb6b-5759528cebec', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f87305-3004-5deb-bb6b-5759528cebec/a2f87305-3004-5deb-bb6b-5759528cebec_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301672}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 55120}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'a2f87305-3004-5deb-bb6b-5759528cebec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 55120,
     'odometer_in_km': 55120,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f87305-3004-5deb-bb6b-5759528cebec/a2f87305-3004-5deb-bb6b-5759528cebec_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301672,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a2f87305-3004-5deb-bb6b-5759528cebec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 55120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f87305-3004-5deb-bb6b-5759528cebec/a2f87305-3004-5deb-bb6b-5759528cebec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/faffd53203044595aafebf3a6688af8b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878508%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [ayvens.es] INFO: Saving data for 1878508: {'created_time': 1769630602.596162, 'last_price_update_time': 1769630602.596174, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878508') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6663b77-3647-5ebe-a4b0-c80a058b97dd with identifier: 1878507
2026-01-28 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6663b77-3647-5ebe-a4b0-c80a058b97dd with identifier: 1878507
2026-01-28 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166056 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166056
2026-01-28 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f6663b77-3647-5ebe-a4b0-c80a058b97dd spider: ayvens.es
2026-01-28 20:03:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: f6663b77-3647-5ebe-a4b0-c80a058b97dd due to rule: high_mileage_for_country.json, error: 166056 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166056
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6663b77-3647-5ebe-a4b0-c80a058b97dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 166056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6663b77-3647-5ebe-a4b0-c80a058b97dd/f6663b77-3647-5ebe-a4b0-c80a058b97dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/092/a83aac708e384c2e9810d4c7099d63d3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878507%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [ayvens.es] INFO: Saving data for 1878507: {'created_time': 1769630602.870557, 'last_price_update_time': 1769630602.870569, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878507') HTTP/1.1" 204 0
2026-01-28 20:03:22 [ayvens.es] INFO: Found listing with ID: 1878517
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878517%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [ayvens.es] INFO: Scrape type for 1878517: 1
2026-01-28 20:03:22 [ayvens.es] INFO: Extracting data for car ID: 1878517
2026-01-28 20:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc with identifier: 1878517
2026-01-28 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc with scrape type 1
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F253%252F43749a1ff3814c6480522f0ad5cf4638%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/253/43749a1ff3814c6480522f0ad5cf4638/images/large/1.jpg not downloaded yet
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca273f10>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d791d3bf-51be-5603-9035-50acaf78b99d/d791d3bf-51be-5603-9035-50acaf78b99d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F944a9f529293480e90f8aa5cf7bea07c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/944a9f529293480e90f8aa5cf7bea07c/images/large/1.jpg saved to cache
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d791d3bf-51be-5603-9035-50acaf78b99d
2026-01-28 20:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d791d3bf-51be-5603-9035-50acaf78b99d, skipping ID generation
2026-01-28 20:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d791d3bf-51be-5603-9035-50acaf78b99d with scrape type 1
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d791d3bf-51be-5603-9035-50acaf78b99d from tracking dictionaries
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d791d3bf-51be-5603-9035-50acaf78b99d sending to next pipeline
2026-01-28 20:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d791d3bf-51be-5603-9035-50acaf78b99d, identifier: 1878509
2026-01-28 20:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/854/d028a58befff4d1da9686619bc8faffb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/835/8f1df8af5080473a8183ab28891ab2bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:23 [ayvens.es] INFO: Found listing with ID: 1878518
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878518%27 HTTP/1.1" 200 None
2026-01-28 20:03:23 [ayvens.es] INFO: Scrape type for 1878518: 1
2026-01-28 20:03:23 [ayvens.es] INFO: Extracting data for car ID: 1878518
2026-01-28 20:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c73cb5-0cfd-538f-87ab-579d2d77f145 with identifier: 1878518
2026-01-28 20:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c73cb5-0cfd-538f-87ab-579d2d77f145 with scrape type 1
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b7c73cb5-0cfd-538f-87ab-579d2d77f145
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F432a70a8ca9d45c48c7d6fb565277355%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg not downloaded yet
2026-01-28 20:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d791d3bf-51be-5603-9035-50acaf78b99d with identifier: 1878509
2026-01-28 20:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d791d3bf-51be-5603-9035-50acaf78b99d with identifier: 1878509
2026-01-28 20:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d791d3bf-51be-5603-9035-50acaf78b99d with identifier: 1878509 to the API
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/651/944a9f529293480e90f8aa5cf7bea07c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd791d3bf-51be-5603-9035-50acaf78b99d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 72202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d791d3bf-51be-5603-9035-50acaf78b99d/d791d3bf-51be-5603-9035-50acaf78b99d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/651/944a9f529293480e90f8aa5cf7bea07c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sportback S line 30 TDI 85kW (116CV)',
 'transmission': 'manual',
 'trim': 'Sportback S line 30 TDI 85kW (116CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878509%27 HTTP/1.1" 200 None
2026-01-28 20:03:23 [ayvens.es] INFO: Saving data for 1878509: {'created_time': 1769630603.938796, 'last_price_update_time': 1769630603.938807, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878509') HTTP/1.1" 204 0
2026-01-28 20:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/996/e448ad49cb2f450298fce47eb9770967/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/081/8491843c347c4e0eb24472155c89086c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:23 [ayvens.es] INFO: Found listing with ID: 1878519
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878519%27 HTTP/1.1" 200 None
2026-01-28 20:03:23 [ayvens.es] INFO: Scrape type for 1878519: 1
2026-01-28 20:03:23 [ayvens.es] INFO: Extracting data for car ID: 1878519
2026-01-28 20:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178ae04a-7dee-5bee-bc99-beff78754a67 with identifier: 1878519
2026-01-28 20:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178ae04a-7dee-5bee-bc99-beff78754a67 with scrape type 1
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 178ae04a-7dee-5bee-bc99-beff78754a67
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F566%252Ff413c100e8d04255b7600552ee303d4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/566/f413c100e8d04255b7600552ee303d4b/images/large/1.jpg not downloaded yet
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/228/424152b10a324723a096f5f5e39db600/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca88a910>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c7dbcda-3660-5257-a662-de9bdae72589/7c7dbcda-3660-5257-a662-de9bdae72589_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F854%252Fd028a58befff4d1da9686619bc8faffb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/854/d028a58befff4d1da9686619bc8faffb/images/large/1.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c7dbcda-3660-5257-a662-de9bdae72589
2026-01-28 20:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c7dbcda-3660-5257-a662-de9bdae72589, skipping ID generation
2026-01-28 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7dbcda-3660-5257-a662-de9bdae72589 with scrape type 1
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7c7dbcda-3660-5257-a662-de9bdae72589 from tracking dictionaries
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c7dbcda-3660-5257-a662-de9bdae72589 sending to next pipeline
2026-01-28 20:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7c7dbcda-3660-5257-a662-de9bdae72589, identifier: 1878510
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912b690>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a785f4-f247-5707-b835-153b0fb3a389/99a785f4-f247-5707-b835-153b0fb3a389_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F835%252F8f1df8af5080473a8183ab28891ab2bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/835/8f1df8af5080473a8183ab28891ab2bb/images/large/1.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99a785f4-f247-5707-b835-153b0fb3a389
2026-01-28 20:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99a785f4-f247-5707-b835-153b0fb3a389, skipping ID generation
2026-01-28 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a785f4-f247-5707-b835-153b0fb3a389 with scrape type 1
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 99a785f4-f247-5707-b835-153b0fb3a389 from tracking dictionaries
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99a785f4-f247-5707-b835-153b0fb3a389 sending to next pipeline
2026-01-28 20:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99a785f4-f247-5707-b835-153b0fb3a389, identifier: 1878512
2026-01-28 20:03:25 [ayvens.es] INFO: Found listing with ID: 1878520
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878520%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [ayvens.es] INFO: Scrape type for 1878520: 1
2026-01-28 20:03:25 [ayvens.es] INFO: Extracting data for car ID: 1878520
2026-01-28 20:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 with identifier: 1878520
2026-01-28 20:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 with scrape type 1
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F587%252Fa4cc1326fdfe40f6b9f2729d4993d81e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/587/a4cc1326fdfe40f6b9f2729d4993d81e/images/large/1.jpg not downloaded yet
2026-01-28 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7c7dbcda-3660-5257-a662-de9bdae72589 with identifier: 1878510
2026-01-28 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7c7dbcda-3660-5257-a662-de9bdae72589 with identifier: 1878510
2026-01-28 20:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7c7dbcda-3660-5257-a662-de9bdae72589 with identifier: 1878510 to the API
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/854/d028a58befff4d1da9686619bc8faffb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c7dbcda-3660-5257-a662-de9bdae72589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 96061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c7dbcda-3660-5257-a662-de9bdae72589/7c7dbcda-3660-5257-a662-de9bdae72589_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/854/d028a58befff4d1da9686619bc8faffb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878510%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [ayvens.es] INFO: Saving data for 1878510: {'created_time': 1769630605.539433, 'last_price_update_time': 1769630605.539445, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878510') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99a785f4-f247-5707-b835-153b0fb3a389 with identifier: 1878512
2026-01-28 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99a785f4-f247-5707-b835-153b0fb3a389 with identifier: 1878512
2026-01-28 20:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99a785f4-f247-5707-b835-153b0fb3a389 with identifier: 1878512 to the API
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/835/8f1df8af5080473a8183ab28891ab2bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '99a785f4-f247-5707-b835-153b0fb3a389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 1921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a785f4-f247-5707-b835-153b0fb3a389/99a785f4-f247-5707-b835-153b0fb3a389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/835/8f1df8af5080473a8183ab28891ab2bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sportback Advanced 30 TDI 85kW (116CV)',
 'transmission': 'manual',
 'trim': 'Sportback Advanced 30 TDI 85kW (116CV)',
 'vin': None,
 'year': 2024}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878512%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [ayvens.es] INFO: Saving data for 1878512: {'created_time': 1769630605.972642, 'last_price_update_time': 1769630605.972654, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878512') HTTP/1.1" 204 0
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/793/1ab7da3c54a44171a6222901d2aa7702/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:26 [ayvens.es] INFO: Found listing with ID: 1878521
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878521%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [ayvens.es] INFO: Scrape type for 1878521: 1
2026-01-28 20:03:26 [ayvens.es] INFO: Extracting data for car ID: 1878521
2026-01-28 20:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ab8a76-0931-520e-a35f-488fe6e05550 with identifier: 1878521
2026-01-28 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ab8a76-0931-520e-a35f-488fe6e05550 with scrape type 1
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23ab8a76-0931-520e-a35f-488fe6e05550
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F040%252F71912f9210b144e09e45e7ad48ecb664%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/040/71912f9210b144e09e45e7ad48ecb664/images/large/1.jpg not downloaded yet
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca5f2a90>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9db909-a024-5d69-b85a-daf188be74e5/cd9db909-a024-5d69-b85a-daf188be74e5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F996%252Fe448ad49cb2f450298fce47eb9770967%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/996/e448ad49cb2f450298fce47eb9770967/images/large/1.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd9db909-a024-5d69-b85a-daf188be74e5
2026-01-28 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd9db909-a024-5d69-b85a-daf188be74e5, skipping ID generation
2026-01-28 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9db909-a024-5d69-b85a-daf188be74e5 with scrape type 1
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cd9db909-a024-5d69-b85a-daf188be74e5 from tracking dictionaries
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd9db909-a024-5d69-b85a-daf188be74e5 sending to next pipeline
2026-01-28 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cd9db909-a024-5d69-b85a-daf188be74e5, identifier: 1878511
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912e750>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29bc556d-922b-5aeb-af65-c086976f8f01/29bc556d-922b-5aeb-af65-c086976f8f01_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F081%252F8491843c347c4e0eb24472155c89086c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/081/8491843c347c4e0eb24472155c89086c/images/large/1.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29bc556d-922b-5aeb-af65-c086976f8f01
2026-01-28 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29bc556d-922b-5aeb-af65-c086976f8f01, skipping ID generation
2026-01-28 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29bc556d-922b-5aeb-af65-c086976f8f01 with scrape type 1
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 29bc556d-922b-5aeb-af65-c086976f8f01 from tracking dictionaries
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29bc556d-922b-5aeb-af65-c086976f8f01 sending to next pipeline
2026-01-28 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29bc556d-922b-5aeb-af65-c086976f8f01, identifier: 1878513
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9150dd0>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e31b757-5ae4-57be-9712-f5f6369db485/8e31b757-5ae4-57be-9712-f5f6369db485_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252F424152b10a324723a096f5f5e39db600%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/424152b10a324723a096f5f5e39db600/images/large/1.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e31b757-5ae4-57be-9712-f5f6369db485
2026-01-28 20:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e31b757-5ae4-57be-9712-f5f6369db485, skipping ID generation
2026-01-28 20:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e31b757-5ae4-57be-9712-f5f6369db485 with scrape type 1
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8e31b757-5ae4-57be-9712-f5f6369db485 from tracking dictionaries
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e31b757-5ae4-57be-9712-f5f6369db485 sending to next pipeline
2026-01-28 20:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8e31b757-5ae4-57be-9712-f5f6369db485, identifier: 1878514
2026-01-28 20:03:27 [ayvens.es] INFO: Found listing with ID: 1878522
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878522%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [ayvens.es] INFO: Scrape type for 1878522: 1
2026-01-28 20:03:27 [ayvens.es] INFO: Extracting data for car ID: 1878522
2026-01-28 20:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e17b2c19-4b04-5b8f-b660-812d7725ad67 with identifier: 1878522
2026-01-28 20:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e17b2c19-4b04-5b8f-b660-812d7725ad67 with scrape type 1
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e17b2c19-4b04-5b8f-b660-812d7725ad67
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252Fddf0898009e84ed1950ac411b8696bc2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/ddf0898009e84ed1950ac411b8696bc2/images/large/1.jpg not downloaded yet
2026-01-28 20:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cd9db909-a024-5d69-b85a-daf188be74e5 with identifier: 1878511
2026-01-28 20:03:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cd9db909-a024-5d69-b85a-daf188be74e5 with identifier: 1878511
2026-01-28 20:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cd9db909-a024-5d69-b85a-daf188be74e5 with identifier: 1878511 to the API
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/996/e448ad49cb2f450298fce47eb9770967/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Glaciersilber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cd9db909-a024-5d69-b85a-daf188be74e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 12673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9db909-a024-5d69-b85a-daf188be74e5/cd9db909-a024-5d69-b85a-daf188be74e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/996/e448ad49cb2f450298fce47eb9770967/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 (E) 320d Auto.Touring',
 'transmission': 'manual',
 'trim': '(E) 320d Auto.Touring',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878511%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [ayvens.es] INFO: Saving data for 1878511: {'created_time': 1769630607.953985, 'last_price_update_time': 1769630607.953996, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878511') HTTP/1.1" 204 0
2026-01-28 20:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29bc556d-922b-5aeb-af65-c086976f8f01 with identifier: 1878513
2026-01-28 20:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29bc556d-922b-5aeb-af65-c086976f8f01 with identifier: 1878513
2026-01-28 20:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29bc556d-922b-5aeb-af65-c086976f8f01 with identifier: 1878513 to the API
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/081/8491843c347c4e0eb24472155c89086c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '29bc556d-922b-5aeb-af65-c086976f8f01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 68126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29bc556d-922b-5aeb-af65-c086976f8f01/29bc556d-922b-5aeb-af65-c086976f8f01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/081/8491843c347c4e0eb24472155c89086c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 66kW (90CV) Selective',
 'transmission': 'manual',
 'trim': '1.4 66kW (90CV) Selective',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878513%27 HTTP/1.1" 200 None
2026-01-28 20:03:28 [ayvens.es] INFO: Saving data for 1878513: {'created_time': 1769630608.513037, 'last_price_update_time': 1769630608.513046, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878513') HTTP/1.1" 204 0
2026-01-28 20:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8e31b757-5ae4-57be-9712-f5f6369db485 with identifier: 1878514
2026-01-28 20:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8e31b757-5ae4-57be-9712-f5f6369db485 with identifier: 1878514
2026-01-28 20:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8e31b757-5ae4-57be-9712-f5f6369db485 with identifier: 1878514 to the API
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/228/424152b10a324723a096f5f5e39db600/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8e31b757-5ae4-57be-9712-f5f6369db485',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 10521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e31b757-5ae4-57be-9712-f5f6369db485/8e31b757-5ae4-57be-9712-f5f6369db485_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/228/424152b10a324723a096f5f5e39db600/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Evolution dCi 100 (74kw)',
 'transmission': 'manual',
 'trim': 'Evolution dCi 100 (74kw)',
 'vin': None,
 'year': 2024}
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878514%27 HTTP/1.1" 200 None
2026-01-28 20:03:28 [ayvens.es] INFO: Saving data for 1878514: {'created_time': 1769630608.876771, 'last_price_update_time': 1769630608.876783, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878514') HTTP/1.1" 204 0
2026-01-28 20:03:28 [ayvens.es] INFO: Found listing with ID: 1878523
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878523%27 HTTP/1.1" 200 None
2026-01-28 20:03:28 [ayvens.es] INFO: Scrape type for 1878523: 1
2026-01-28 20:03:28 [ayvens.es] INFO: Extracting data for car ID: 1878523
2026-01-28 20:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070bca92-d12d-5e82-adfc-d732f6592abf with identifier: 1878523
2026-01-28 20:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070bca92-d12d-5e82-adfc-d732f6592abf with scrape type 1
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 070bca92-d12d-5e82-adfc-d732f6592abf
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F84cd669b188f482194c38a11910a8d48%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg not downloaded yet
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9174ad0>
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_307fb249-1159-5ac4-9a7e-3f34ac62813c/307fb249-1159-5ac4-9a7e-3f34ac62813c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F1ab7da3c54a44171a6222901d2aa7702%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/1ab7da3c54a44171a6222901d2aa7702/images/large/1.jpg saved to cache
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 307fb249-1159-5ac4-9a7e-3f34ac62813c
2026-01-28 20:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 307fb249-1159-5ac4-9a7e-3f34ac62813c, skipping ID generation
2026-01-28 20:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 307fb249-1159-5ac4-9a7e-3f34ac62813c with scrape type 1
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 307fb249-1159-5ac4-9a7e-3f34ac62813c from tracking dictionaries
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 307fb249-1159-5ac4-9a7e-3f34ac62813c sending to next pipeline
2026-01-28 20:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 307fb249-1159-5ac4-9a7e-3f34ac62813c, identifier: 1878515
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9175350>
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_188f0868-ada2-5f74-b11d-83cd462ffdbc/188f0868-ada2-5f74-b11d-83cd462ffdbc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F699%252F9767b4b85c53495dade0b24790d3f1e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg saved to cache
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 188f0868-ada2-5f74-b11d-83cd462ffdbc
2026-01-28 20:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 188f0868-ada2-5f74-b11d-83cd462ffdbc, skipping ID generation
2026-01-28 20:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 188f0868-ada2-5f74-b11d-83cd462ffdbc with scrape type 1
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 188f0868-ada2-5f74-b11d-83cd462ffdbc from tracking dictionaries
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 188f0868-ada2-5f74-b11d-83cd462ffdbc sending to next pipeline
2026-01-28 20:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 188f0868-ada2-5f74-b11d-83cd462ffdbc, identifier: 1878516
2026-01-28 20:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 307fb249-1159-5ac4-9a7e-3f34ac62813c with identifier: 1878515
2026-01-28 20:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 307fb249-1159-5ac4-9a7e-3f34ac62813c with identifier: 1878515
2026-01-28 20:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 307fb249-1159-5ac4-9a7e-3f34ac62813c with identifier: 1878515 to the API
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/793/1ab7da3c54a44171a6222901d2aa7702/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '307fb249-1159-5ac4-9a7e-3f34ac62813c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 108520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_307fb249-1159-5ac4-9a7e-3f34ac62813c/307fb249-1159-5ac4-9a7e-3f34ac62813c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/793/1ab7da3c54a44171a6222901d2aa7702/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878515%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [ayvens.es] INFO: Saving data for 1878515: {'created_time': 1769630610.361224, 'last_price_update_time': 1769630610.361236, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878515') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 188f0868-ada2-5f74-b11d-83cd462ffdbc with identifier: 1878516
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 188f0868-ada2-5f74-b11d-83cd462ffdbc with identifier: 1878516
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 42348, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-03', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '188f0868-ada2-5f74-b11d-83cd462ffdbc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_188f0868-ada2-5f74-b11d-83cd462ffdbc/188f0868-ada2-5f74-b11d-83cd462ffdbc_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 351371}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 42348}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': '188f0868-ada2-5f74-b11d-83cd462ffdbc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 42348,
     'odometer_in_km': 42348,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_188f0868-ada2-5f74-b11d-83cd462ffdbc/188f0868-ada2-5f74-b11d-83cd462ffdbc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 351371,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-03',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 188f0868-ada2-5f74-b11d-83cd462ffdbc spider: ayvens.es
2026-01-28 20:03:30 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 188f0868-ada2-5f74-b11d-83cd462ffdbc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 42348, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-03', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '188f0868-ada2-5f74-b11d-83cd462ffdbc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_188f0868-ada2-5f74-b11d-83cd462ffdbc/188f0868-ada2-5f74-b11d-83cd462ffdbc_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 351371}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 42348}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'petrol',
     'id': '188f0868-ada2-5f74-b11d-83cd462ffdbc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 42348,
     'odometer_in_km': 42348,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_188f0868-ada2-5f74-b11d-83cd462ffdbc/188f0868-ada2-5f74-b11d-83cd462ffdbc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 351371,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-03',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '188f0868-ada2-5f74-b11d-83cd462ffdbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 42348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_188f0868-ada2-5f74-b11d-83cd462ffdbc/188f0868-ada2-5f74-b11d-83cd462ffdbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/699/9767b4b85c53495dade0b24790d3f1e2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878516%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [ayvens.es] INFO: Saving data for 1878516: {'created_time': 1769630610.639853, 'last_price_update_time': 1769630610.639865, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878516') HTTP/1.1" 204 0
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/253/43749a1ff3814c6480522f0ad5cf4638/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [ayvens.es] INFO: Found listing with ID: 1878524
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878524%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [ayvens.es] INFO: Scrape type for 1878524: 1
2026-01-28 20:03:30 [ayvens.es] INFO: Extracting data for car ID: 1878524
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce9c79b-8eb5-5787-9434-473488911475 with identifier: 1878524
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce9c79b-8eb5-5787-9434-473488911475 with scrape type 1
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ce9c79b-8eb5-5787-9434-473488911475
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fba067f699c0c4a34b3045cbcc1ff47d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/ba067f699c0c4a34b3045cbcc1ff47d0/images/large/1.jpg not downloaded yet
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/566/f413c100e8d04255b7600552ee303d4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [ayvens.es] INFO: Found listing with ID: 1878525
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878525%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [ayvens.es] INFO: Scrape type for 1878525: 1
2026-01-28 20:03:30 [ayvens.es] INFO: Extracting data for car ID: 1878525
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd with identifier: 1878525
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd with scrape type 1
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F913%252F8cf351206dac4cfcaadad4ecd262ff27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/913/8cf351206dac4cfcaadad4ecd262ff27/images/large/1.jpg not downloaded yet
2026-01-28 20:03:30 [ayvens.es] INFO: Found listing with ID: 1878526
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878526%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [ayvens.es] INFO: Scrape type for 1878526: 1
2026-01-28 20:03:30 [ayvens.es] INFO: Extracting data for car ID: 1878526
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf06c22-3448-5708-8da7-4935aa922ec6 with identifier: 1878526
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf06c22-3448-5708-8da7-4935aa922ec6 with scrape type 1
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8bf06c22-3448-5708-8da7-4935aa922ec6
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252Fd754f397bc824c678bbce78ff337ae13%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/d754f397bc824c678bbce78ff337ae13/images/large/1.jpg not downloaded yet
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/587/a4cc1326fdfe40f6b9f2729d4993d81e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/040/71912f9210b144e09e45e7ad48ecb664/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca2699d0>
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc/9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F253%252F43749a1ff3814c6480522f0ad5cf4638%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/253/43749a1ff3814c6480522f0ad5cf4638/images/large/1.jpg saved to cache
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc
2026-01-28 20:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc, skipping ID generation
2026-01-28 20:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc with scrape type 1
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc from tracking dictionaries
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc sending to next pipeline
2026-01-28 20:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc, identifier: 1878517
2026-01-28 20:03:31 [ayvens.es] INFO: Found listing with ID: 1878527
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878527%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [ayvens.es] INFO: Scrape type for 1878527: 1
2026-01-28 20:03:31 [ayvens.es] INFO: Extracting data for car ID: 1878527
2026-01-28 20:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e99f7d-ea09-52d3-b0fb-be3792a08a35 with identifier: 1878527
2026-01-28 20:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e99f7d-ea09-52d3-b0fb-be3792a08a35 with scrape type 1
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4e99f7d-ea09-52d3-b0fb-be3792a08a35
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Ff7ea1ea73b8a4dbcabdfe3d9c1e67332%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/f7ea1ea73b8a4dbcabdfe3d9c1e67332/images/large/1.jpg not downloaded yet
2026-01-28 20:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc with identifier: 1878517
2026-01-28 20:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc with identifier: 1878517
2026-01-28 20:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc with identifier: 1878517 to the API
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/253/43749a1ff3814c6480522f0ad5cf4638/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 131152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc/9d6697f4-6767-5e3c-b6c6-6fe601b0ebbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/253/43749a1ff3814c6480522f0ad5cf4638/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.0 TDCi 110kW 4x2 A-S-S ST-Line',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW 4x2 A-S-S ST-Line',
 'vin': None,
 'year': 2018}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878517%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [ayvens.es] INFO: Saving data for 1878517: {'created_time': 1769630611.808719, 'last_price_update_time': 1769630611.808731, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878517') HTTP/1.1" 204 0
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca8457d0>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178ae04a-7dee-5bee-bc99-beff78754a67/178ae04a-7dee-5bee-bc99-beff78754a67_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F566%252Ff413c100e8d04255b7600552ee303d4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/566/f413c100e8d04255b7600552ee303d4b/images/large/1.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 178ae04a-7dee-5bee-bc99-beff78754a67
2026-01-28 20:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 178ae04a-7dee-5bee-bc99-beff78754a67, skipping ID generation
2026-01-28 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178ae04a-7dee-5bee-bc99-beff78754a67 with scrape type 1
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 178ae04a-7dee-5bee-bc99-beff78754a67 from tracking dictionaries
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 178ae04a-7dee-5bee-bc99-beff78754a67 sending to next pipeline
2026-01-28 20:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 178ae04a-7dee-5bee-bc99-beff78754a67, identifier: 1878519
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9140290>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7c73cb5-0cfd-538f-87ab-579d2d77f145/b7c73cb5-0cfd-538f-87ab-579d2d77f145_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F432a70a8ca9d45c48c7d6fb565277355%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7c73cb5-0cfd-538f-87ab-579d2d77f145
2026-01-28 20:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7c73cb5-0cfd-538f-87ab-579d2d77f145, skipping ID generation
2026-01-28 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c73cb5-0cfd-538f-87ab-579d2d77f145 with scrape type 1
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b7c73cb5-0cfd-538f-87ab-579d2d77f145 from tracking dictionaries
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7c73cb5-0cfd-538f-87ab-579d2d77f145 sending to next pipeline
2026-01-28 20:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b7c73cb5-0cfd-538f-87ab-579d2d77f145, identifier: 1878518
2026-01-28 20:03:32 [ayvens.es] INFO: Found listing with ID: 1878528
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878528%27 HTTP/1.1" 200 None
2026-01-28 20:03:32 [ayvens.es] INFO: Scrape type for 1878528: 1
2026-01-28 20:03:32 [ayvens.es] INFO: Extracting data for car ID: 1878528
2026-01-28 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1277bac5-ad4c-517d-aa05-f2d796043b7a with identifier: 1878528
2026-01-28 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1277bac5-ad4c-517d-aa05-f2d796043b7a with scrape type 1
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1277bac5-ad4c-517d-aa05-f2d796043b7a
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252F050c1015916d4e29a3926d4c8d9491f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/050c1015916d4e29a3926d4c8d9491f3/images/large/1.jpg not downloaded yet
2026-01-28 20:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 178ae04a-7dee-5bee-bc99-beff78754a67 with identifier: 1878519
2026-01-28 20:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 178ae04a-7dee-5bee-bc99-beff78754a67 with identifier: 1878519
2026-01-28 20:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153031
2026-01-28 20:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 178ae04a-7dee-5bee-bc99-beff78754a67 spider: ayvens.es
2026-01-28 20:03:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 178ae04a-7dee-5bee-bc99-beff78754a67 due to rule: high_mileage_for_country.json, error: 153031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153031
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '178ae04a-7dee-5bee-bc99-beff78754a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 153031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178ae04a-7dee-5bee-bc99-beff78754a67/178ae04a-7dee-5bee-bc99-beff78754a67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/566/f413c100e8d04255b7600552ee303d4b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 220 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 220 d 4MATIC',
 'vin': None,
 'year': 2022}
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878519%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [ayvens.es] INFO: Saving data for 1878519: {'created_time': 1769630613.04041, 'last_price_update_time': 1769630613.040423, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878519') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b7c73cb5-0cfd-538f-87ab-579d2d77f145 with identifier: 1878518
2026-01-28 20:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b7c73cb5-0cfd-538f-87ab-579d2d77f145 with identifier: 1878518
2026-01-28 20:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'golf', 'trim': 'sport 2.0 tdi 150cv bmt', 'title': 'volkswagen golf sport 2.0 tdi 150cv bmt', 'price': 0, 'odometer': 218827, 'odometer_reading_unit': 'km', 'registration_date': '2015-04-15', 'year': 2015, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 3, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 106, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b7c73cb5-0cfd-538f-87ab-579d2d77f145', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c73cb5-0cfd-538f-87ab-579d2d77f145/b7c73cb5-0cfd-538f-87ab-579d2d77f145_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 342950}], 'current_year_diff': 11, 'age_in_months': 129, 'make_model': 'volkswagen golf', 'sanitized_make': 'volkswagen', 'odometer_in_km': 218827}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 129,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 11,
     'doors_number': 3,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'b7c73cb5-0cfd-538f-87ab-579d2d77f145',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen golf',
     'model': 'golf',
     'odometer': 218827,
     'odometer_in_km': 218827,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c73cb5-0cfd-538f-87ab-579d2d77f145/b7c73cb5-0cfd-538f-87ab-579d2d77f145_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 342950,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-04-15',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen golf sport 2.0 tdi 150cv bmt',
     'transmission': 'manual',
     'trim': 'sport 2.0 tdi 150cv bmt',
     'vin': None,
     'year': 2015}
2026-01-28 20:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: b7c73cb5-0cfd-538f-87ab-579d2d77f145 spider: ayvens.es
2026-01-28 20:03:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b7c73cb5-0cfd-538f-87ab-579d2d77f145 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'golf', 'trim': 'sport 2.0 tdi 150cv bmt', 'title': 'volkswagen golf sport 2.0 tdi 150cv bmt', 'price': 0, 'odometer': 218827, 'odometer_reading_unit': 'km', 'registration_date': '2015-04-15', 'year': 2015, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 3, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 106, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b7c73cb5-0cfd-538f-87ab-579d2d77f145', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c73cb5-0cfd-538f-87ab-579d2d77f145/b7c73cb5-0cfd-538f-87ab-579d2d77f145_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 342950}], 'current_year_diff': 11, 'age_in_months': 129, 'make_model': 'volkswagen golf', 'sanitized_make': 'volkswagen', 'odometer_in_km': 218827}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 129,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 11,
     'doors_number': 3,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'b7c73cb5-0cfd-538f-87ab-579d2d77f145',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen golf',
     'model': 'golf',
     'odometer': 218827,
     'odometer_in_km': 218827,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c73cb5-0cfd-538f-87ab-579d2d77f145/b7c73cb5-0cfd-538f-87ab-579d2d77f145_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 342950,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-04-15',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen golf sport 2.0 tdi 150cv bmt',
     'transmission': 'manual',
     'trim': 'sport 2.0 tdi 150cv bmt',
     'vin': None,
     'year': 2015}
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b7c73cb5-0cfd-538f-87ab-579d2d77f145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 218827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c73cb5-0cfd-538f-87ab-579d2d77f145/b7c73cb5-0cfd-538f-87ab-579d2d77f145_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/432a70a8ca9d45c48c7d6fb565277355/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Sport 2.0 TDI 150CV BMT',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 150CV BMT',
 'vin': None,
 'year': 2015}
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878518%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [ayvens.es] INFO: Saving data for 1878518: {'created_time': 1769630613.287335, 'last_price_update_time': 1769630613.287347, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878518') HTTP/1.1" 204 0
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca22e210>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_361abba1-4aa5-5b2d-bcc9-7cc3f8983d12/361abba1-4aa5-5b2d-bcc9-7cc3f8983d12_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F587%252Fa4cc1326fdfe40f6b9f2729d4993d81e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/587/a4cc1326fdfe40f6b9f2729d4993d81e/images/large/1.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12
2026-01-28 20:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12, skipping ID generation
2026-01-28 20:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 with scrape type 1
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 from tracking dictionaries
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 sending to next pipeline
2026-01-28 20:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12, identifier: 1878520
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1f0a10>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23ab8a76-0931-520e-a35f-488fe6e05550/23ab8a76-0931-520e-a35f-488fe6e05550_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F040%252F71912f9210b144e09e45e7ad48ecb664%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/040/71912f9210b144e09e45e7ad48ecb664/images/large/1.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23ab8a76-0931-520e-a35f-488fe6e05550
2026-01-28 20:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23ab8a76-0931-520e-a35f-488fe6e05550, skipping ID generation
2026-01-28 20:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ab8a76-0931-520e-a35f-488fe6e05550 with scrape type 1
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 23ab8a76-0931-520e-a35f-488fe6e05550 from tracking dictionaries
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23ab8a76-0931-520e-a35f-488fe6e05550 sending to next pipeline
2026-01-28 20:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23ab8a76-0931-520e-a35f-488fe6e05550, identifier: 1878521
2026-01-28 20:03:34 [ayvens.es] INFO: Found listing with ID: 1878529
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878529%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [ayvens.es] INFO: Scrape type for 1878529: 1
2026-01-28 20:03:34 [ayvens.es] INFO: Extracting data for car ID: 1878529
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b43e565f-ebd5-59d5-a74b-0714659e3bdf with identifier: 1878529
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43e565f-ebd5-59d5-a74b-0714659e3bdf with scrape type 1
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b43e565f-ebd5-59d5-a74b-0714659e3bdf
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F026e3c8f5ede4b23ab0e0db2760f059b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/026e3c8f5ede4b23ab0e0db2760f059b/images/large/1.jpg not downloaded yet
2026-01-28 20:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 with identifier: 1878520
2026-01-28 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 with identifier: 1878520
2026-01-28 20:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 361abba1-4aa5-5b2d-bcc9-7cc3f8983d12 with identifier: 1878520 to the API
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/587/a4cc1326fdfe40f6b9f2729d4993d81e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '361abba1-4aa5-5b2d-bcc9-7cc3f8983d12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 93014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_361abba1-4aa5-5b2d-bcc9-7cc3f8983d12/361abba1-4aa5-5b2d-bcc9-7cc3f8983d12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/587/a4cc1326fdfe40f6b9f2729d4993d81e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878520%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [ayvens.es] INFO: Saving data for 1878520: {'created_time': 1769630614.410514, 'last_price_update_time': 1769630614.410524, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878520') HTTP/1.1" 204 0
2026-01-28 20:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23ab8a76-0931-520e-a35f-488fe6e05550 with identifier: 1878521
2026-01-28 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23ab8a76-0931-520e-a35f-488fe6e05550 with identifier: 1878521
2026-01-28 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-28 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 23ab8a76-0931-520e-a35f-488fe6e05550 spider: ayvens.es
2026-01-28 20:03:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 23ab8a76-0931-520e-a35f-488fe6e05550 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '23ab8a76-0931-520e-a35f-488fe6e05550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 102843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23ab8a76-0931-520e-a35f-488fe6e05550/23ab8a76-0931-520e-a35f-488fe6e05550_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/040/71912f9210b144e09e45e7ad48ecb664/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878521%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [ayvens.es] INFO: Saving data for 1878521: {'created_time': 1769630614.658011, 'last_price_update_time': 1769630614.658021, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878521') HTTP/1.1" 204 0
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/874/ddf0898009e84ed1950ac411b8696bc2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/875/ba067f699c0c4a34b3045cbcc1ff47d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/913/8cf351206dac4cfcaadad4ecd262ff27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/574/d754f397bc824c678bbce78ff337ae13/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/675/f7ea1ea73b8a4dbcabdfe3d9c1e67332/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca243510>
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17b2c19-4b04-5b8f-b660-812d7725ad67/e17b2c19-4b04-5b8f-b660-812d7725ad67_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252Fddf0898009e84ed1950ac411b8696bc2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/ddf0898009e84ed1950ac411b8696bc2/images/large/1.jpg saved to cache
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e17b2c19-4b04-5b8f-b660-812d7725ad67
2026-01-28 20:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e17b2c19-4b04-5b8f-b660-812d7725ad67, skipping ID generation
2026-01-28 20:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e17b2c19-4b04-5b8f-b660-812d7725ad67 with scrape type 1
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e17b2c19-4b04-5b8f-b660-812d7725ad67 from tracking dictionaries
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e17b2c19-4b04-5b8f-b660-812d7725ad67 sending to next pipeline
2026-01-28 20:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e17b2c19-4b04-5b8f-b660-812d7725ad67, identifier: 1878522
2026-01-28 20:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e17b2c19-4b04-5b8f-b660-812d7725ad67 with identifier: 1878522
2026-01-28 20:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e17b2c19-4b04-5b8f-b660-812d7725ad67 with identifier: 1878522
2026-01-28 20:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e17b2c19-4b04-5b8f-b660-812d7725ad67 with identifier: 1878522 to the API
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/874/ddf0898009e84ed1950ac411b8696bc2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e17b2c19-4b04-5b8f-b660-812d7725ad67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 95459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17b2c19-4b04-5b8f-b660-812d7725ad67/e17b2c19-4b04-5b8f-b660-812d7725ad67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/874/ddf0898009e84ed1950ac411b8696bc2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878522%27 HTTP/1.1" 200 None
2026-01-28 20:03:35 [ayvens.es] INFO: Saving data for 1878522: {'created_time': 1769630615.925115, 'last_price_update_time': 1769630615.92513, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878522') HTTP/1.1" 204 0
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1f2fd0>
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce9c79b-8eb5-5787-9434-473488911475/8ce9c79b-8eb5-5787-9434-473488911475_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fba067f699c0c4a34b3045cbcc1ff47d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/ba067f699c0c4a34b3045cbcc1ff47d0/images/large/1.jpg saved to cache
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ce9c79b-8eb5-5787-9434-473488911475
2026-01-28 20:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ce9c79b-8eb5-5787-9434-473488911475, skipping ID generation
2026-01-28 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce9c79b-8eb5-5787-9434-473488911475 with scrape type 1
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ce9c79b-8eb5-5787-9434-473488911475 from tracking dictionaries
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ce9c79b-8eb5-5787-9434-473488911475 sending to next pipeline
2026-01-28 20:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ce9c79b-8eb5-5787-9434-473488911475, identifier: 1878524
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9012ed0>
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070bca92-d12d-5e82-adfc-d732f6592abf/070bca92-d12d-5e82-adfc-d732f6592abf_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F84cd669b188f482194c38a11910a8d48%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg saved to cache
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 070bca92-d12d-5e82-adfc-d732f6592abf
2026-01-28 20:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 070bca92-d12d-5e82-adfc-d732f6592abf, skipping ID generation
2026-01-28 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070bca92-d12d-5e82-adfc-d732f6592abf with scrape type 1
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 070bca92-d12d-5e82-adfc-d732f6592abf from tracking dictionaries
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 070bca92-d12d-5e82-adfc-d732f6592abf sending to next pipeline
2026-01-28 20:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 070bca92-d12d-5e82-adfc-d732f6592abf, identifier: 1878523
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9158a50>
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd/ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F913%252F8cf351206dac4cfcaadad4ecd262ff27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/913/8cf351206dac4cfcaadad4ecd262ff27/images/large/1.jpg saved to cache
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd
2026-01-28 20:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd, skipping ID generation
2026-01-28 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd with scrape type 1
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd from tracking dictionaries
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd sending to next pipeline
2026-01-28 20:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd, identifier: 1878525
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca62e890>
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf06c22-3448-5708-8da7-4935aa922ec6/8bf06c22-3448-5708-8da7-4935aa922ec6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252Fd754f397bc824c678bbce78ff337ae13%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/d754f397bc824c678bbce78ff337ae13/images/large/1.jpg saved to cache
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bf06c22-3448-5708-8da7-4935aa922ec6
2026-01-28 20:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bf06c22-3448-5708-8da7-4935aa922ec6, skipping ID generation
2026-01-28 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf06c22-3448-5708-8da7-4935aa922ec6 with scrape type 1
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8bf06c22-3448-5708-8da7-4935aa922ec6 from tracking dictionaries
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bf06c22-3448-5708-8da7-4935aa922ec6 sending to next pipeline
2026-01-28 20:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8bf06c22-3448-5708-8da7-4935aa922ec6, identifier: 1878526
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fc4c10>
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e99f7d-ea09-52d3-b0fb-be3792a08a35/b4e99f7d-ea09-52d3-b0fb-be3792a08a35_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Ff7ea1ea73b8a4dbcabdfe3d9c1e67332%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/f7ea1ea73b8a4dbcabdfe3d9c1e67332/images/large/1.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4e99f7d-ea09-52d3-b0fb-be3792a08a35
2026-01-28 20:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4e99f7d-ea09-52d3-b0fb-be3792a08a35, skipping ID generation
2026-01-28 20:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e99f7d-ea09-52d3-b0fb-be3792a08a35 with scrape type 1
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b4e99f7d-ea09-52d3-b0fb-be3792a08a35 from tracking dictionaries
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4e99f7d-ea09-52d3-b0fb-be3792a08a35 sending to next pipeline
2026-01-28 20:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4e99f7d-ea09-52d3-b0fb-be3792a08a35, identifier: 1878527
2026-01-28 20:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ce9c79b-8eb5-5787-9434-473488911475 with identifier: 1878524
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ce9c79b-8eb5-5787-9434-473488911475 with identifier: 1878524
2026-01-28 20:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ce9c79b-8eb5-5787-9434-473488911475 with identifier: 1878524 to the API
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/875/ba067f699c0c4a34b3045cbcc1ff47d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8ce9c79b-8eb5-5787-9434-473488911475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 87353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce9c79b-8eb5-5787-9434-473488911475/8ce9c79b-8eb5-5787-9434-473488911475_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/875/ba067f699c0c4a34b3045cbcc1ff47d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878524%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [ayvens.es] INFO: Saving data for 1878524: {'created_time': 1769630618.547228, 'last_price_update_time': 1769630618.54724, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878524') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 070bca92-d12d-5e82-adfc-d732f6592abf with identifier: 1878523
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 070bca92-d12d-5e82-adfc-d732f6592abf with identifier: 1878523
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'transit courier', 'trim': 'van 1.5 tdci 56kw trend', 'title': 'ford transit courier van 1.5 tdci 56kw trend', 'price': 0, 'odometer': 280631, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-05', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 113, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '070bca92-d12d-5e82-adfc-d732f6592abf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070bca92-d12d-5e82-adfc-d732f6592abf/070bca92-d12d-5e82-adfc-d732f6592abf_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 555995}], 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'ford transit courier', 'sanitized_make': 'ford', 'odometer_in_km': 280631}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '070bca92-d12d-5e82-adfc-d732f6592abf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford transit courier',
     'model': 'transit courier',
     'odometer': 280631,
     'odometer_in_km': 280631,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070bca92-d12d-5e82-adfc-d732f6592abf/070bca92-d12d-5e82-adfc-d732f6592abf_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 555995,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-05',
     'sanitized_make': 'ford',
     'seats_number': 2,
     'seller_name': None,
     'title': 'ford transit courier van 1.5 tdci 56kw trend',
     'transmission': 'manual',
     'trim': 'van 1.5 tdci 56kw trend',
     'vin': None,
     'year': 2020}
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 070bca92-d12d-5e82-adfc-d732f6592abf spider: ayvens.es
2026-01-28 20:03:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 070bca92-d12d-5e82-adfc-d732f6592abf due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'transit courier', 'trim': 'van 1.5 tdci 56kw trend', 'title': 'ford transit courier van 1.5 tdci 56kw trend', 'price': 0, 'odometer': 280631, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-05', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166', 'expiration_date': '2026-01-29t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 113, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '070bca92-d12d-5e82-adfc-d732f6592abf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070bca92-d12d-5e82-adfc-d732f6592abf/070bca92-d12d-5e82-adfc-d732f6592abf_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 555995}], 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'ford transit courier', 'sanitized_make': 'ford', 'odometer_in_km': 280631}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-29t12:00:00z',
     'fuel_type': 'diesel',
     'id': '070bca92-d12d-5e82-adfc-d732f6592abf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford transit courier',
     'model': 'transit courier',
     'odometer': 280631,
     'odometer_in_km': 280631,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070bca92-d12d-5e82-adfc-d732f6592abf/070bca92-d12d-5e82-adfc-d732f6592abf_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 555995,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-05',
     'sanitized_make': 'ford',
     'seats_number': 2,
     'seller_name': None,
     'title': 'ford transit courier van 1.5 tdci 56kw trend',
     'transmission': 'manual',
     'trim': 'van 1.5 tdci 56kw trend',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '070bca92-d12d-5e82-adfc-d732f6592abf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 280631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070bca92-d12d-5e82-adfc-d732f6592abf/070bca92-d12d-5e82-adfc-d732f6592abf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/84cd669b188f482194c38a11910a8d48/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878523%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [ayvens.es] INFO: Saving data for 1878523: {'created_time': 1769630618.898506, 'last_price_update_time': 1769630618.89852, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878523') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd with identifier: 1878525
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd with identifier: 1878525
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd spider: ayvens.es
2026-01-28 20:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 60355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd/ca3d067c-0511-5c14-ae2a-ddecfeeb2bdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/913/8cf351206dac4cfcaadad4ecd262ff27/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878525%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [ayvens.es] INFO: Saving data for 1878525: {'created_time': 1769630619.260845, 'last_price_update_time': 1769630619.260858, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878525') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8bf06c22-3448-5708-8da7-4935aa922ec6 with identifier: 1878526
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8bf06c22-3448-5708-8da7-4935aa922ec6 with identifier: 1878526
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8bf06c22-3448-5708-8da7-4935aa922ec6 spider: ayvens.es
2026-01-28 20:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8bf06c22-3448-5708-8da7-4935aa922ec6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8bf06c22-3448-5708-8da7-4935aa922ec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 29863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf06c22-3448-5708-8da7-4935aa922ec6/8bf06c22-3448-5708-8da7-4935aa922ec6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/574/d754f397bc824c678bbce78ff337ae13/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878526%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [ayvens.es] INFO: Saving data for 1878526: {'created_time': 1769630619.564656, 'last_price_update_time': 1769630619.564667, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878526') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4e99f7d-ea09-52d3-b0fb-be3792a08a35 with identifier: 1878527
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4e99f7d-ea09-52d3-b0fb-be3792a08a35 with identifier: 1878527
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-28 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b4e99f7d-ea09-52d3-b0fb-be3792a08a35 spider: ayvens.es
2026-01-28 20:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b4e99f7d-ea09-52d3-b0fb-be3792a08a35 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4e99f7d-ea09-52d3-b0fb-be3792a08a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 86671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e99f7d-ea09-52d3-b0fb-be3792a08a35/b4e99f7d-ea09-52d3-b0fb-be3792a08a35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/675/f7ea1ea73b8a4dbcabdfe3d9c1e67332/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878527%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [ayvens.es] INFO: Saving data for 1878527: {'created_time': 1769630619.807255, 'last_price_update_time': 1769630619.807264, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878527') HTTP/1.1" 204 0
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/499/026e3c8f5ede4b23ab0e0db2760f059b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/760/050c1015916d4e29a3926d4c8d9491f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca912150>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b43e565f-ebd5-59d5-a74b-0714659e3bdf/b43e565f-ebd5-59d5-a74b-0714659e3bdf_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F026e3c8f5ede4b23ab0e0db2760f059b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/026e3c8f5ede4b23ab0e0db2760f059b/images/large/1.jpg saved to cache
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b43e565f-ebd5-59d5-a74b-0714659e3bdf
2026-01-28 20:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b43e565f-ebd5-59d5-a74b-0714659e3bdf, skipping ID generation
2026-01-28 20:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43e565f-ebd5-59d5-a74b-0714659e3bdf with scrape type 1
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b43e565f-ebd5-59d5-a74b-0714659e3bdf from tracking dictionaries
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b43e565f-ebd5-59d5-a74b-0714659e3bdf sending to next pipeline
2026-01-28 20:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b43e565f-ebd5-59d5-a74b-0714659e3bdf, identifier: 1878529
2026-01-28 20:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b43e565f-ebd5-59d5-a74b-0714659e3bdf with identifier: 1878529
2026-01-28 20:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b43e565f-ebd5-59d5-a74b-0714659e3bdf with identifier: 1878529
2026-01-28 20:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b43e565f-ebd5-59d5-a74b-0714659e3bdf with identifier: 1878529 to the API
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/499/026e3c8f5ede4b23ab0e0db2760f059b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b43e565f-ebd5-59d5-a74b-0714659e3bdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 78109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b43e565f-ebd5-59d5-a74b-0714659e3bdf/b43e565f-ebd5-59d5-a74b-0714659e3bdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/499/026e3c8f5ede4b23ab0e0db2760f059b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878529%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [ayvens.es] INFO: Saving data for 1878529: {'created_time': 1769630621.471938, 'last_price_update_time': 1769630621.471948, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878529') HTTP/1.1" 204 0
2026-01-28 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca842550>
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1277bac5-ad4c-517d-aa05-f2d796043b7a/1277bac5-ad4c-517d-aa05-f2d796043b7a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252F050c1015916d4e29a3926d4c8d9491f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/050c1015916d4e29a3926d4c8d9491f3/images/large/1.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1277bac5-ad4c-517d-aa05-f2d796043b7a
2026-01-28 20:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1277bac5-ad4c-517d-aa05-f2d796043b7a, skipping ID generation
2026-01-28 20:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1277bac5-ad4c-517d-aa05-f2d796043b7a with scrape type 1
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1277bac5-ad4c-517d-aa05-f2d796043b7a from tracking dictionaries
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1277bac5-ad4c-517d-aa05-f2d796043b7a sending to next pipeline
2026-01-28 20:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1277bac5-ad4c-517d-aa05-f2d796043b7a, identifier: 1878528
2026-01-28 20:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1277bac5-ad4c-517d-aa05-f2d796043b7a with identifier: 1878528
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1277bac5-ad4c-517d-aa05-f2d796043b7a with identifier: 1878528
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1277bac5-ad4c-517d-aa05-f2d796043b7a spider: ayvens.es
2026-01-28 20:03:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1277bac5-ad4c-517d-aa05-f2d796043b7a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1277bac5-ad4c-517d-aa05-f2d796043b7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 137060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1277bac5-ad4c-517d-aa05-f2d796043b7a/1277bac5-ad4c-517d-aa05-f2d796043b7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/760/050c1015916d4e29a3926d4c8d9491f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 320 L2 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 320 L2 Trend',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878528%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Saving data for 1878528: {'created_time': 1769630622.134006, 'last_price_update_time': 1769630622.134015, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878528') HTTP/1.1" 204 0
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878530
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878530%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878530: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878530
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26377f10-8527-5b1d-92f0-c163b1c92b3f with identifier: 1878530
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26377f10-8527-5b1d-92f0-c163b1c92b3f with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26377f10-8527-5b1d-92f0-c163b1c92b3f
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252Fcda28e16ef7446beba669b7d6f02036b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/cda28e16ef7446beba669b7d6f02036b/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878531
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878531%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878531: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878531
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b691a0-5feb-5803-8152-c13c89e5453a with identifier: 1878531
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b691a0-5feb-5803-8152-c13c89e5453a with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62b691a0-5feb-5803-8152-c13c89e5453a
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F725%252F9c8770e311ef4c9ba12213b01f5dd1a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/725/9c8770e311ef4c9ba12213b01f5dd1a8/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878532
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878532%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878532: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878532
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 with identifier: 1878532
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F492%252F819db675cb484dc4a2bcec1396d62944%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/492/819db675cb484dc4a2bcec1396d62944/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878533
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878533%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878533: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878533
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca668e02-ad0b-5e13-97f2-98fb58379ed2 with identifier: 1878533
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca668e02-ad0b-5e13-97f2-98fb58379ed2 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca668e02-ad0b-5e13-97f2-98fb58379ed2
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252Fc5418a0c258b4226929ad7dfdbd0c3c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/c5418a0c258b4226929ad7dfdbd0c3c3/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878534
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878534%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878534: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878534
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00897dde-31eb-5b89-abe8-3328efaa8be2 with identifier: 1878534
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00897dde-31eb-5b89-abe8-3328efaa8be2 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 00897dde-31eb-5b89-abe8-3328efaa8be2
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F6d868f8fb3504b39943e811be624846b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/6d868f8fb3504b39943e811be624846b/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878535
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878535%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878535: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878535
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba837f7f-1a8d-5ea7-af4b-bf52563529c2 with identifier: 1878535
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba837f7f-1a8d-5ea7-af4b-bf52563529c2 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba837f7f-1a8d-5ea7-af4b-bf52563529c2
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252F3c7df0ed3a104ed8bfd7d90f448cfb20%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/3c7df0ed3a104ed8bfd7d90f448cfb20/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878734
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878734%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878734: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878734
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891f6c97-9ce2-5633-af26-e4584953b7d1 with identifier: 1878734
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891f6c97-9ce2-5633-af26-e4584953b7d1 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 891f6c97-9ce2-5633-af26-e4584953b7d1
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fdb0b03fee5ed4fd0b6c8cb50092297d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/db0b03fee5ed4fd0b6c8cb50092297d2/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878735
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878735%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878735: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878735
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd85950-c800-5671-ae67-dddb2a38900d with identifier: 1878735
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd85950-c800-5671-ae67-dddb2a38900d with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2dd85950-c800-5671-ae67-dddb2a38900d
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F310%252Ff594dde59b034212ac2ccf51b9723ceb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/310/f594dde59b034212ac2ccf51b9723ceb/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878736
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878736%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878736: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878736
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50dd93f5-47c7-5596-bd31-3e061388ccf4 with identifier: 1878736
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50dd93f5-47c7-5596-bd31-3e061388ccf4 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 50dd93f5-47c7-5596-bd31-3e061388ccf4
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252F2a2974e298274c0f9afd8708946a049f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/2a2974e298274c0f9afd8708946a049f/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878737
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878737%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878737: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878737
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ca1488-8c24-5c5c-b244-0a582a862e14 with identifier: 1878737
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ca1488-8c24-5c5c-b244-0a582a862e14 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 71ca1488-8c24-5c5c-b244-0a582a862e14
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252F2033cd13f2e645d699ae8993b1711b74%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/2033cd13f2e645d699ae8993b1711b74/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/cda28e16ef7446beba669b7d6f02036b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878738
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878738%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878738: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878738
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f1431e2-fac4-53bb-b06f-74dc5d552686 with identifier: 1878738
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1431e2-fac4-53bb-b06f-74dc5d552686 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f1431e2-fac4-53bb-b06f-74dc5d552686
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252Fe9878af59b9842fd81b33a15d808bc96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/e9878af59b9842fd81b33a15d808bc96/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878739
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878739%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878739: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878739
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64fed505-9307-5e93-b0d8-e3fb3bbadf22 with identifier: 1878739
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64fed505-9307-5e93-b0d8-e3fb3bbadf22 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64fed505-9307-5e93-b0d8-e3fb3bbadf22
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F8cb460eab896469c80f1460705f3aea1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/8cb460eab896469c80f1460705f3aea1/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878740
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878740%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878740: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878740
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 376d0590-83ba-5d3f-9833-b02f619ed8c6 with identifier: 1878740
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 376d0590-83ba-5d3f-9833-b02f619ed8c6 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 376d0590-83ba-5d3f-9833-b02f619ed8c6
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F912%252F3e3d4ee57ba34a9ca1e396a1d8a7d713%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/912/3e3d4ee57ba34a9ca1e396a1d8a7d713/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.es] INFO: Found listing with ID: 1878741
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878741%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.es] INFO: Scrape type for 1878741: 1
2026-01-28 20:03:42 [ayvens.es] INFO: Extracting data for car ID: 1878741
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66418072-afcd-55b5-aa10-132e1cb26c5b with identifier: 1878741
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66418072-afcd-55b5-aa10-132e1cb26c5b with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 66418072-afcd-55b5-aa10-132e1cb26c5b
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F225%252Fdbc056232376483faeebd14b0513942b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/225/dbc056232376483faeebd14b0513942b/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91470d0>
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26377f10-8527-5b1d-92f0-c163b1c92b3f/26377f10-8527-5b1d-92f0-c163b1c92b3f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252Fcda28e16ef7446beba669b7d6f02036b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/cda28e16ef7446beba669b7d6f02036b/images/large/1.jpg saved to cache
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26377f10-8527-5b1d-92f0-c163b1c92b3f
2026-01-28 20:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26377f10-8527-5b1d-92f0-c163b1c92b3f, skipping ID generation
2026-01-28 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26377f10-8527-5b1d-92f0-c163b1c92b3f with scrape type 1
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 26377f10-8527-5b1d-92f0-c163b1c92b3f from tracking dictionaries
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26377f10-8527-5b1d-92f0-c163b1c92b3f sending to next pipeline
2026-01-28 20:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26377f10-8527-5b1d-92f0-c163b1c92b3f, identifier: 1878530
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/689/6d868f8fb3504b39943e811be624846b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/725/9c8770e311ef4c9ba12213b01f5dd1a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:43 [ayvens.es] INFO: Found listing with ID: 1878742
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878742%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [ayvens.es] INFO: Scrape type for 1878742: 1
2026-01-28 20:03:43 [ayvens.es] INFO: Extracting data for car ID: 1878742
2026-01-28 20:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f103b59-3597-5285-93c2-a2e70f591412 with identifier: 1878742
2026-01-28 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f103b59-3597-5285-93c2-a2e70f591412 with scrape type 1
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f103b59-3597-5285-93c2-a2e70f591412
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F671%252Fbea5320a6eca465a82c159ff8c51fb72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/671/bea5320a6eca465a82c159ff8c51fb72/images/large/1.jpg not downloaded yet
2026-01-28 20:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26377f10-8527-5b1d-92f0-c163b1c92b3f with identifier: 1878530
2026-01-28 20:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26377f10-8527-5b1d-92f0-c163b1c92b3f with identifier: 1878530
2026-01-28 20:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 26377f10-8527-5b1d-92f0-c163b1c92b3f with identifier: 1878530 to the API
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/562/cda28e16ef7446beba669b7d6f02036b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '26377f10-8527-5b1d-92f0-c163b1c92b3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 33739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26377f10-8527-5b1d-92f0-c163b1c92b3f/26377f10-8527-5b1d-92f0-c163b1c92b3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/cda28e16ef7446beba669b7d6f02036b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103 kW (140 CV) E6D N-STYLE',
 'transmission': 'manual',
 'trim': 'DIG-T 103 kW (140 CV) E6D N-STYLE',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878530%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [ayvens.es] INFO: Saving data for 1878530: {'created_time': 1769630623.678054, 'last_price_update_time': 1769630623.678064, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878530') HTTP/1.1" 204 0
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/255/3c7df0ed3a104ed8bfd7d90f448cfb20/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/103/c5418a0c258b4226929ad7dfdbd0c3c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:43 [ayvens.es] INFO: Found listing with ID: 1878743
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878743%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [ayvens.es] INFO: Scrape type for 1878743: 1
2026-01-28 20:03:43 [ayvens.es] INFO: Extracting data for car ID: 1878743
2026-01-28 20:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2a086c4-f02f-5ada-a456-dd463fa91178 with identifier: 1878743
2026-01-28 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2a086c4-f02f-5ada-a456-dd463fa91178 with scrape type 1
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2a086c4-f02f-5ada-a456-dd463fa91178
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F677%252F9416c84b6762420d8105e0281d98872c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/677/9416c84b6762420d8105e0281d98872c/images/large/1.jpg not downloaded yet
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/492/819db675cb484dc4a2bcec1396d62944/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fdec50>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00897dde-31eb-5b89-abe8-3328efaa8be2/00897dde-31eb-5b89-abe8-3328efaa8be2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F6d868f8fb3504b39943e811be624846b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/6d868f8fb3504b39943e811be624846b/images/large/1.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00897dde-31eb-5b89-abe8-3328efaa8be2
2026-01-28 20:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00897dde-31eb-5b89-abe8-3328efaa8be2, skipping ID generation
2026-01-28 20:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00897dde-31eb-5b89-abe8-3328efaa8be2 with scrape type 1
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 00897dde-31eb-5b89-abe8-3328efaa8be2 from tracking dictionaries
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00897dde-31eb-5b89-abe8-3328efaa8be2 sending to next pipeline
2026-01-28 20:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 00897dde-31eb-5b89-abe8-3328efaa8be2, identifier: 1878534
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fc6dd0>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62b691a0-5feb-5803-8152-c13c89e5453a/62b691a0-5feb-5803-8152-c13c89e5453a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F725%252F9c8770e311ef4c9ba12213b01f5dd1a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/725/9c8770e311ef4c9ba12213b01f5dd1a8/images/large/1.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62b691a0-5feb-5803-8152-c13c89e5453a
2026-01-28 20:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62b691a0-5feb-5803-8152-c13c89e5453a, skipping ID generation
2026-01-28 20:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b691a0-5feb-5803-8152-c13c89e5453a with scrape type 1
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 62b691a0-5feb-5803-8152-c13c89e5453a from tracking dictionaries
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62b691a0-5feb-5803-8152-c13c89e5453a sending to next pipeline
2026-01-28 20:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62b691a0-5feb-5803-8152-c13c89e5453a, identifier: 1878531
2026-01-28 20:03:46 [ayvens.es] INFO: Found listing with ID: 1878744
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878744%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [ayvens.es] INFO: Scrape type for 1878744: 1
2026-01-28 20:03:46 [ayvens.es] INFO: Extracting data for car ID: 1878744
2026-01-28 20:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ab6f05-f777-5746-93ad-0c25b401b2c9 with identifier: 1878744
2026-01-28 20:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ab6f05-f777-5746-93ad-0c25b401b2c9 with scrape type 1
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0ab6f05-f777-5746-93ad-0c25b401b2c9
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F399%252F0ab8248f76174e18b5bff7b77315e614%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/399/0ab8248f76174e18b5bff7b77315e614/images/large/1.jpg not downloaded yet
2026-01-28 20:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 00897dde-31eb-5b89-abe8-3328efaa8be2 with identifier: 1878534
2026-01-28 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 00897dde-31eb-5b89-abe8-3328efaa8be2 with identifier: 1878534
2026-01-28 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
2026-01-28 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 00897dde-31eb-5b89-abe8-3328efaa8be2 spider: ayvens.es
2026-01-28 20:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 00897dde-31eb-5b89-abe8-3328efaa8be2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '00897dde-31eb-5b89-abe8-3328efaa8be2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 82230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00897dde-31eb-5b89-abe8-3328efaa8be2/00897dde-31eb-5b89-abe8-3328efaa8be2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/689/6d868f8fb3504b39943e811be624846b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.5D 75kW (100CV) GX 650kg Media',
 'transmission': 'manual',
 'trim': '1.5D 75kW (100CV) GX 650kg Media',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878534%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [ayvens.es] INFO: Saving data for 1878534: {'created_time': 1769630626.889475, 'last_price_update_time': 1769630626.889487, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878534') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62b691a0-5feb-5803-8152-c13c89e5453a with identifier: 1878531
2026-01-28 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62b691a0-5feb-5803-8152-c13c89e5453a with identifier: 1878531
2026-01-28 20:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 62b691a0-5feb-5803-8152-c13c89e5453a with identifier: 1878531 to the API
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/725/9c8770e311ef4c9ba12213b01f5dd1a8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '62b691a0-5feb-5803-8152-c13c89e5453a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 69843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b691a0-5feb-5803-8152-c13c89e5453a/62b691a0-5feb-5803-8152-c13c89e5453a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/725/9c8770e311ef4c9ba12213b01f5dd1a8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878531%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [ayvens.es] INFO: Saving data for 1878531: {'created_time': 1769630627.337044, 'last_price_update_time': 1769630627.33707, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878531') HTTP/1.1" 204 0
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/943/2a2974e298274c0f9afd8708946a049f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/192/db0b03fee5ed4fd0b6c8cb50092297d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/310/f594dde59b034212ac2ccf51b9723ceb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:47 [ayvens.es] INFO: Found listing with ID: 1878745
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878745%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [ayvens.es] INFO: Scrape type for 1878745: 1
2026-01-28 20:03:47 [ayvens.es] INFO: Extracting data for car ID: 1878745
2026-01-28 20:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4dea948-7dc4-5e49-970e-1698c77b5665 with identifier: 1878745
2026-01-28 20:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4dea948-7dc4-5e49-970e-1698c77b5665 with scrape type 1
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d4dea948-7dc4-5e49-970e-1698c77b5665
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F337%252F658d0a9eec5a45eea85ec97a2fd18c05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/337/658d0a9eec5a45eea85ec97a2fd18c05/images/large/1.jpg not downloaded yet
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca877010>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba837f7f-1a8d-5ea7-af4b-bf52563529c2/ba837f7f-1a8d-5ea7-af4b-bf52563529c2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252F3c7df0ed3a104ed8bfd7d90f448cfb20%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/3c7df0ed3a104ed8bfd7d90f448cfb20/images/large/1.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba837f7f-1a8d-5ea7-af4b-bf52563529c2
2026-01-28 20:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba837f7f-1a8d-5ea7-af4b-bf52563529c2, skipping ID generation
2026-01-28 20:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba837f7f-1a8d-5ea7-af4b-bf52563529c2 with scrape type 1
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ba837f7f-1a8d-5ea7-af4b-bf52563529c2 from tracking dictionaries
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba837f7f-1a8d-5ea7-af4b-bf52563529c2 sending to next pipeline
2026-01-28 20:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ba837f7f-1a8d-5ea7-af4b-bf52563529c2, identifier: 1878535
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fccb50>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca668e02-ad0b-5e13-97f2-98fb58379ed2/ca668e02-ad0b-5e13-97f2-98fb58379ed2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252Fc5418a0c258b4226929ad7dfdbd0c3c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/c5418a0c258b4226929ad7dfdbd0c3c3/images/large/1.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca668e02-ad0b-5e13-97f2-98fb58379ed2
2026-01-28 20:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca668e02-ad0b-5e13-97f2-98fb58379ed2, skipping ID generation
2026-01-28 20:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca668e02-ad0b-5e13-97f2-98fb58379ed2 with scrape type 1
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ca668e02-ad0b-5e13-97f2-98fb58379ed2 from tracking dictionaries
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca668e02-ad0b-5e13-97f2-98fb58379ed2 sending to next pipeline
2026-01-28 20:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca668e02-ad0b-5e13-97f2-98fb58379ed2, identifier: 1878533
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9163b50>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757f9b8b-74d0-5f45-bb54-71a88fc2e8c2/757f9b8b-74d0-5f45-bb54-71a88fc2e8c2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F492%252F819db675cb484dc4a2bcec1396d62944%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/492/819db675cb484dc4a2bcec1396d62944/images/large/1.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2
2026-01-28 20:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2, skipping ID generation
2026-01-28 20:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 with scrape type 1
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 from tracking dictionaries
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 sending to next pipeline
2026-01-28 20:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2, identifier: 1878532
2026-01-28 20:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ba837f7f-1a8d-5ea7-af4b-bf52563529c2 with identifier: 1878535
2026-01-28 20:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ba837f7f-1a8d-5ea7-af4b-bf52563529c2 with identifier: 1878535
2026-01-28 20:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ba837f7f-1a8d-5ea7-af4b-bf52563529c2 with identifier: 1878535 to the API
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/255/3c7df0ed3a104ed8bfd7d90f448cfb20/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ba837f7f-1a8d-5ea7-af4b-bf52563529c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 7072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba837f7f-1a8d-5ea7-af4b-bf52563529c2/ba837f7f-1a8d-5ea7-af4b-bf52563529c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/255/3c7df0ed3a104ed8bfd7d90f448cfb20/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2024}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878535%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [ayvens.es] INFO: Saving data for 1878535: {'created_time': 1769630629.117749, 'last_price_update_time': 1769630629.117763, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878535') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca668e02-ad0b-5e13-97f2-98fb58379ed2 with identifier: 1878533
2026-01-28 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca668e02-ad0b-5e13-97f2-98fb58379ed2 with identifier: 1878533
2026-01-28 20:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca668e02-ad0b-5e13-97f2-98fb58379ed2 with identifier: 1878533 to the API
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/103/c5418a0c258b4226929ad7dfdbd0c3c3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ca668e02-ad0b-5e13-97f2-98fb58379ed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 57856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca668e02-ad0b-5e13-97f2-98fb58379ed2/ca668e02-ad0b-5e13-97f2-98fb58379ed2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/103/c5418a0c258b4226929ad7dfdbd0c3c3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878533%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [ayvens.es] INFO: Saving data for 1878533: {'created_time': 1769630629.562155, 'last_price_update_time': 1769630629.562168, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878533') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 with identifier: 1878532
2026-01-28 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 with identifier: 1878532
2026-01-28 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-28 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 spider: ayvens.es
2026-01-28 20:03:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 757f9b8b-74d0-5f45-bb54-71a88fc2e8c2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '757f9b8b-74d0-5f45-bb54-71a88fc2e8c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39166',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 115421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757f9b8b-74d0-5f45-bb54-71a88fc2e8c2/757f9b8b-74d0-5f45-bb54-71a88fc2e8c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/492/819db675cb484dc4a2bcec1396d62944/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD S/S 75kW (100CV) Select L H1 650k',
 'transmission': 'manual',
 'trim': '1.5 TD S/S 75kW (100CV) Select L H1 650k',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878532%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [ayvens.es] INFO: Saving data for 1878532: {'created_time': 1769630629.824541, 'last_price_update_time': 1769630629.824553, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878532') HTTP/1.1" 204 0
2026-01-28 20:03:49 [ayvens.es] INFO: Found listing with ID: 1878746
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878746%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [ayvens.es] INFO: Scrape type for 1878746: 1
2026-01-28 20:03:49 [ayvens.es] INFO: Extracting data for car ID: 1878746
2026-01-28 20:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb85210c-70e7-5627-808e-62fa21e57e2f with identifier: 1878746
2026-01-28 20:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb85210c-70e7-5627-808e-62fa21e57e2f with scrape type 1
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb85210c-70e7-5627-808e-62fa21e57e2f
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252F9b19a9051c9848cf8b2e1fce2c916138%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/9b19a9051c9848cf8b2e1fce2c916138/images/large/1.jpg not downloaded yet
2026-01-28 20:03:49 [ayvens.es] INFO: Found listing with ID: 1878747
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878747%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [ayvens.es] INFO: Scrape type for 1878747: 1
2026-01-28 20:03:49 [ayvens.es] INFO: Extracting data for car ID: 1878747
2026-01-28 20:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d94a5012-eb83-5481-a9df-9358eaef5082 with identifier: 1878747
2026-01-28 20:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d94a5012-eb83-5481-a9df-9358eaef5082 with scrape type 1
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d94a5012-eb83-5481-a9df-9358eaef5082
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F773%252F04e2d6c8789e448ab03e7b82628ccebd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/773/04e2d6c8789e448ab03e7b82628ccebd/images/large/1.jpg not downloaded yet
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912af10>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50dd93f5-47c7-5596-bd31-3e061388ccf4/50dd93f5-47c7-5596-bd31-3e061388ccf4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252F2a2974e298274c0f9afd8708946a049f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/2a2974e298274c0f9afd8708946a049f/images/large/1.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50dd93f5-47c7-5596-bd31-3e061388ccf4
2026-01-28 20:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50dd93f5-47c7-5596-bd31-3e061388ccf4, skipping ID generation
2026-01-28 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50dd93f5-47c7-5596-bd31-3e061388ccf4 with scrape type 1
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 50dd93f5-47c7-5596-bd31-3e061388ccf4 from tracking dictionaries
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50dd93f5-47c7-5596-bd31-3e061388ccf4 sending to next pipeline
2026-01-28 20:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 50dd93f5-47c7-5596-bd31-3e061388ccf4, identifier: 1878736
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c912ba10>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_891f6c97-9ce2-5633-af26-e4584953b7d1/891f6c97-9ce2-5633-af26-e4584953b7d1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fdb0b03fee5ed4fd0b6c8cb50092297d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/db0b03fee5ed4fd0b6c8cb50092297d2/images/large/1.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 891f6c97-9ce2-5633-af26-e4584953b7d1
2026-01-28 20:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 891f6c97-9ce2-5633-af26-e4584953b7d1, skipping ID generation
2026-01-28 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891f6c97-9ce2-5633-af26-e4584953b7d1 with scrape type 1
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 891f6c97-9ce2-5633-af26-e4584953b7d1 from tracking dictionaries
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 891f6c97-9ce2-5633-af26-e4584953b7d1 sending to next pipeline
2026-01-28 20:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 891f6c97-9ce2-5633-af26-e4584953b7d1, identifier: 1878734
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca64c710>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd85950-c800-5671-ae67-dddb2a38900d/2dd85950-c800-5671-ae67-dddb2a38900d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F310%252Ff594dde59b034212ac2ccf51b9723ceb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/310/f594dde59b034212ac2ccf51b9723ceb/images/large/1.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dd85950-c800-5671-ae67-dddb2a38900d
2026-01-28 20:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dd85950-c800-5671-ae67-dddb2a38900d, skipping ID generation
2026-01-28 20:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd85950-c800-5671-ae67-dddb2a38900d with scrape type 1
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2dd85950-c800-5671-ae67-dddb2a38900d from tracking dictionaries
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dd85950-c800-5671-ae67-dddb2a38900d sending to next pipeline
2026-01-28 20:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2dd85950-c800-5671-ae67-dddb2a38900d, identifier: 1878735
2026-01-28 20:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/912/3e3d4ee57ba34a9ca1e396a1d8a7d713/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 50dd93f5-47c7-5596-bd31-3e061388ccf4 with identifier: 1878736
2026-01-28 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 50dd93f5-47c7-5596-bd31-3e061388ccf4 with identifier: 1878736
2026-01-28 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 50dd93f5-47c7-5596-bd31-3e061388ccf4 spider: ayvens.es
2026-01-28 20:03:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 50dd93f5-47c7-5596-bd31-3e061388ccf4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Blanco jade',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '50dd93f5-47c7-5596-bd31-3e061388ccf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 139487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50dd93f5-47c7-5596-bd31-3e061388ccf4/50dd93f5-47c7-5596-bd31-3e061388ccf4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/943/2a2974e298274c0f9afd8708946a049f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-28',
 'seats_number': 9,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) L Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) L Std Express',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878736%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [ayvens.es] INFO: Saving data for 1878736: {'created_time': 1769630631.665157, 'last_price_update_time': 1769630631.665168, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878736') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 891f6c97-9ce2-5633-af26-e4584953b7d1 with identifier: 1878734
2026-01-28 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 891f6c97-9ce2-5633-af26-e4584953b7d1 with identifier: 1878734
2026-01-28 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153342 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153342
2026-01-28 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 891f6c97-9ce2-5633-af26-e4584953b7d1 spider: ayvens.es
2026-01-28 20:03:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 891f6c97-9ce2-5633-af26-e4584953b7d1 due to rule: high_mileage_for_country.json, error: 153342 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153342
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '891f6c97-9ce2-5633-af26-e4584953b7d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 153342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891f6c97-9ce2-5633-af26-e4584953b7d1/891f6c97-9ce2-5633-af26-e4584953b7d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/192/db0b03fee5ed4fd0b6c8cb50092297d2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.5D DT 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.5D DT 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878734%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [ayvens.es] INFO: Saving data for 1878734: {'created_time': 1769630631.954572, 'last_price_update_time': 1769630631.954584, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878734') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2dd85950-c800-5671-ae67-dddb2a38900d with identifier: 1878735
2026-01-28 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2dd85950-c800-5671-ae67-dddb2a38900d with identifier: 1878735
2026-01-28 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2026-01-28 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2dd85950-c800-5671-ae67-dddb2a38900d spider: ayvens.es
2026-01-28 20:03:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 2dd85950-c800-5671-ae67-dddb2a38900d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2dd85950-c800-5671-ae67-dddb2a38900d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO',
 'odometer': 181043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd85950-c800-5671-ae67-dddb2a38900d/2dd85950-c800-5671-ae67-dddb2a38900d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/310/f594dde59b034212ac2ccf51b9723ceb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FIAT DUCATO 30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'transmission': 'manual',
 'trim': '30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878735%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [ayvens.es] INFO: Saving data for 1878735: {'created_time': 1769630632.236594, 'last_price_update_time': 1769630632.236606, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878735') HTTP/1.1" 204 0
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/649/2033cd13f2e645d699ae8993b1711b74/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/828/8cb460eab896469c80f1460705f3aea1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/809/e9878af59b9842fd81b33a15d808bc96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [ayvens.es] INFO: Found listing with ID: 1878748
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878748%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [ayvens.es] INFO: Scrape type for 1878748: 1
2026-01-28 20:03:52 [ayvens.es] INFO: Extracting data for car ID: 1878748
2026-01-28 20:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1eefd7-7444-5252-9211-b75e1c582f73 with identifier: 1878748
2026-01-28 20:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1eefd7-7444-5252-9211-b75e1c582f73 with scrape type 1
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d1eefd7-7444-5252-9211-b75e1c582f73
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252F2f9e8260f5b349bfb54e55b32d1cc7ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/2f9e8260f5b349bfb54e55b32d1cc7ed/images/large/1.jpg not downloaded yet
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/225/dbc056232376483faeebd14b0513942b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/677/9416c84b6762420d8105e0281d98872c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [ayvens.es] INFO: Found listing with ID: 1878749
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878749%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [ayvens.es] INFO: Scrape type for 1878749: 1
2026-01-28 20:03:52 [ayvens.es] INFO: Extracting data for car ID: 1878749
2026-01-28 20:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460ab97b-50a0-5549-a822-cd4473c6dbe3 with identifier: 1878749
2026-01-28 20:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460ab97b-50a0-5549-a822-cd4473c6dbe3 with scrape type 1
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 460ab97b-50a0-5549-a822-cd4473c6dbe3
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F85582fc50e0740479805e5751285d1a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/85582fc50e0740479805e5751285d1a9/images/large/1.jpg not downloaded yet
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fcd290>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_376d0590-83ba-5d3f-9833-b02f619ed8c6/376d0590-83ba-5d3f-9833-b02f619ed8c6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F912%252F3e3d4ee57ba34a9ca1e396a1d8a7d713%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/912/3e3d4ee57ba34a9ca1e396a1d8a7d713/images/large/1.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 376d0590-83ba-5d3f-9833-b02f619ed8c6
2026-01-28 20:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 376d0590-83ba-5d3f-9833-b02f619ed8c6, skipping ID generation
2026-01-28 20:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 376d0590-83ba-5d3f-9833-b02f619ed8c6 with scrape type 1
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 376d0590-83ba-5d3f-9833-b02f619ed8c6 from tracking dictionaries
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 376d0590-83ba-5d3f-9833-b02f619ed8c6 sending to next pipeline
2026-01-28 20:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 376d0590-83ba-5d3f-9833-b02f619ed8c6, identifier: 1878740
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/671/bea5320a6eca465a82c159ff8c51fb72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [ayvens.es] INFO: Found listing with ID: 1878750
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878750%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [ayvens.es] INFO: Scrape type for 1878750: 1
2026-01-28 20:03:52 [ayvens.es] INFO: Extracting data for car ID: 1878750
2026-01-28 20:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ffb28d-224c-5a9e-942a-2554d6eb2573 with identifier: 1878750
2026-01-28 20:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ffb28d-224c-5a9e-942a-2554d6eb2573 with scrape type 1
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23ffb28d-224c-5a9e-942a-2554d6eb2573
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F322%252F2445944fe60b4a1598e914edeb7dd2fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/322/2445944fe60b4a1598e914edeb7dd2fd/images/large/1.jpg not downloaded yet
2026-01-28 20:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 376d0590-83ba-5d3f-9833-b02f619ed8c6 with identifier: 1878740
2026-01-28 20:03:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 376d0590-83ba-5d3f-9833-b02f619ed8c6 with identifier: 1878740
2026-01-28 20:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumper' containing 'jumper'
2026-01-28 20:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 376d0590-83ba-5d3f-9833-b02f619ed8c6 spider: ayvens.es
2026-01-28 20:03:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 376d0590-83ba-5d3f-9833-b02f619ed8c6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumper' containing 'jumper'
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Banquies blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '376d0590-83ba-5d3f-9833-b02f619ed8c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPER',
 'odometer': 95142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_376d0590-83ba-5d3f-9833-b02f619ed8c6/376d0590-83ba-5d3f-9833-b02f619ed8c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/912/3e3d4ee57ba34a9ca1e396a1d8a7d713/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPER BlueHDi 81KW (110CV) Furgon 33L2H1',
 'transmission': 'manual',
 'trim': 'BlueHDi 81KW (110CV) Furgon 33L2H1',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878740%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [ayvens.es] INFO: Saving data for 1878740: {'created_time': 1769630633.257085, 'last_price_update_time': 1769630633.257097, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878740') HTTP/1.1" 204 0
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c8fcef50>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ca1488-8c24-5c5c-b244-0a582a862e14/71ca1488-8c24-5c5c-b244-0a582a862e14_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252F2033cd13f2e645d699ae8993b1711b74%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/2033cd13f2e645d699ae8993b1711b74/images/large/1.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71ca1488-8c24-5c5c-b244-0a582a862e14
2026-01-28 20:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71ca1488-8c24-5c5c-b244-0a582a862e14, skipping ID generation
2026-01-28 20:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ca1488-8c24-5c5c-b244-0a582a862e14 with scrape type 1
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 71ca1488-8c24-5c5c-b244-0a582a862e14 from tracking dictionaries
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71ca1488-8c24-5c5c-b244-0a582a862e14 sending to next pipeline
2026-01-28 20:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 71ca1488-8c24-5c5c-b244-0a582a862e14, identifier: 1878737
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c917b0d0>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fed505-9307-5e93-b0d8-e3fb3bbadf22/64fed505-9307-5e93-b0d8-e3fb3bbadf22_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F8cb460eab896469c80f1460705f3aea1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/8cb460eab896469c80f1460705f3aea1/images/large/1.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64fed505-9307-5e93-b0d8-e3fb3bbadf22
2026-01-28 20:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64fed505-9307-5e93-b0d8-e3fb3bbadf22, skipping ID generation
2026-01-28 20:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64fed505-9307-5e93-b0d8-e3fb3bbadf22 with scrape type 1
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 64fed505-9307-5e93-b0d8-e3fb3bbadf22 from tracking dictionaries
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64fed505-9307-5e93-b0d8-e3fb3bbadf22 sending to next pipeline
2026-01-28 20:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 64fed505-9307-5e93-b0d8-e3fb3bbadf22, identifier: 1878739
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca294f90>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1431e2-fac4-53bb-b06f-74dc5d552686/5f1431e2-fac4-53bb-b06f-74dc5d552686_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252Fe9878af59b9842fd81b33a15d808bc96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/e9878af59b9842fd81b33a15d808bc96/images/large/1.jpg saved to cache
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f1431e2-fac4-53bb-b06f-74dc5d552686
2026-01-28 20:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f1431e2-fac4-53bb-b06f-74dc5d552686, skipping ID generation
2026-01-28 20:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1431e2-fac4-53bb-b06f-74dc5d552686 with scrape type 1
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5f1431e2-fac4-53bb-b06f-74dc5d552686 from tracking dictionaries
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f1431e2-fac4-53bb-b06f-74dc5d552686 sending to next pipeline
2026-01-28 20:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f1431e2-fac4-53bb-b06f-74dc5d552686, identifier: 1878738
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/399/0ab8248f76174e18b5bff7b77315e614/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [ayvens.es] INFO: Found listing with ID: 1878751
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878751%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [ayvens.es] INFO: Scrape type for 1878751: 1
2026-01-28 20:03:54 [ayvens.es] INFO: Extracting data for car ID: 1878751
2026-01-28 20:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b754f1ee-5064-558e-a672-9590641b0439 with identifier: 1878751
2026-01-28 20:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b754f1ee-5064-558e-a672-9590641b0439 with scrape type 1
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b754f1ee-5064-558e-a672-9590641b0439
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F010%252Fc7b6351845604c2885efaa4c07a0c3e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/010/c7b6351845604c2885efaa4c07a0c3e9/images/large/1.jpg not downloaded yet
2026-01-28 20:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 71ca1488-8c24-5c5c-b244-0a582a862e14 with identifier: 1878737
2026-01-28 20:03:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 71ca1488-8c24-5c5c-b244-0a582a862e14 with identifier: 1878737
2026-01-28 20:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 71ca1488-8c24-5c5c-b244-0a582a862e14 with identifier: 1878737 to the API
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/649/2033cd13f2e645d699ae8993b1711b74/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 66,
 'color': 'Azul navarra metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '71ca1488-8c24-5c5c-b244-0a582a862e14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q8',
 'odometer': 99684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ca1488-8c24-5c5c-b244-0a582a862e14/71ca1488-8c24-5c5c-b244-0a582a862e14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/649/2033cd13f2e645d699ae8993b1711b74/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q8 60 TFSIe S Line Plus 340kW quattro tip',
 'transmission': 'manual',
 'trim': '60 TFSIe S Line Plus 340kW quattro tip',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878737%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [ayvens.es] INFO: Saving data for 1878737: {'created_time': 1769630634.836814, 'last_price_update_time': 1769630634.836827, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878737') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 64fed505-9307-5e93-b0d8-e3fb3bbadf22 with identifier: 1878739
2026-01-28 20:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 64fed505-9307-5e93-b0d8-e3fb3bbadf22 with identifier: 1878739
2026-01-28 20:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 20:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 64fed505-9307-5e93-b0d8-e3fb3bbadf22 spider: ayvens.es
2026-01-28 20:03:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 64fed505-9307-5e93-b0d8-e3fb3bbadf22 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '64fed505-9307-5e93-b0d8-e3fb3bbadf22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 88323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fed505-9307-5e93-b0d8-e3fb3bbadf22/64fed505-9307-5e93-b0d8-e3fb3bbadf22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/828/8cb460eab896469c80f1460705f3aea1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2022}
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878739%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [ayvens.es] INFO: Saving data for 1878739: {'created_time': 1769630635.103845, 'last_price_update_time': 1769630635.103855, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878739') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f1431e2-fac4-53bb-b06f-74dc5d552686 with identifier: 1878738
2026-01-28 20:03:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f1431e2-fac4-53bb-b06f-74dc5d552686 with identifier: 1878738
2026-01-28 20:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 20:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5f1431e2-fac4-53bb-b06f-74dc5d552686 spider: ayvens.es
2026-01-28 20:03:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 5f1431e2-fac4-53bb-b06f-74dc5d552686 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f1431e2-fac4-53bb-b06f-74dc5d552686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 145024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1431e2-fac4-53bb-b06f-74dc5d552686/5f1431e2-fac4-53bb-b06f-74dc5d552686_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/809/e9878af59b9842fd81b33a15d808bc96/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Premium 1.5 BlueHDi 100 Standard',
 'transmission': 'manual',
 'trim': 'Furgon Premium 1.5 BlueHDi 100 Standard',
 'vin': None,
 'year': 2020}
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878738%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [ayvens.es] INFO: Saving data for 1878738: {'created_time': 1769630635.350049, 'last_price_update_time': 1769630635.350059, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878738') HTTP/1.1" 204 0
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9179a10>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66418072-afcd-55b5-aa10-132e1cb26c5b/66418072-afcd-55b5-aa10-132e1cb26c5b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F225%252Fdbc056232376483faeebd14b0513942b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/225/dbc056232376483faeebd14b0513942b/images/large/1.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66418072-afcd-55b5-aa10-132e1cb26c5b
2026-01-28 20:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66418072-afcd-55b5-aa10-132e1cb26c5b, skipping ID generation
2026-01-28 20:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66418072-afcd-55b5-aa10-132e1cb26c5b with scrape type 1
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 66418072-afcd-55b5-aa10-132e1cb26c5b from tracking dictionaries
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66418072-afcd-55b5-aa10-132e1cb26c5b sending to next pipeline
2026-01-28 20:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 66418072-afcd-55b5-aa10-132e1cb26c5b, identifier: 1878741
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9172150>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2a086c4-f02f-5ada-a456-dd463fa91178/f2a086c4-f02f-5ada-a456-dd463fa91178_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F677%252F9416c84b6762420d8105e0281d98872c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/677/9416c84b6762420d8105e0281d98872c/images/large/1.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2a086c4-f02f-5ada-a456-dd463fa91178
2026-01-28 20:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2a086c4-f02f-5ada-a456-dd463fa91178, skipping ID generation
2026-01-28 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2a086c4-f02f-5ada-a456-dd463fa91178 with scrape type 1
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2a086c4-f02f-5ada-a456-dd463fa91178 from tracking dictionaries
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2a086c4-f02f-5ada-a456-dd463fa91178 sending to next pipeline
2026-01-28 20:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2a086c4-f02f-5ada-a456-dd463fa91178, identifier: 1878743
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca205a50>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f103b59-3597-5285-93c2-a2e70f591412/5f103b59-3597-5285-93c2-a2e70f591412_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F671%252Fbea5320a6eca465a82c159ff8c51fb72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/671/bea5320a6eca465a82c159ff8c51fb72/images/large/1.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f103b59-3597-5285-93c2-a2e70f591412
2026-01-28 20:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f103b59-3597-5285-93c2-a2e70f591412, skipping ID generation
2026-01-28 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f103b59-3597-5285-93c2-a2e70f591412 with scrape type 1
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5f103b59-3597-5285-93c2-a2e70f591412 from tracking dictionaries
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f103b59-3597-5285-93c2-a2e70f591412 sending to next pipeline
2026-01-28 20:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f103b59-3597-5285-93c2-a2e70f591412, identifier: 1878742
2026-01-28 20:03:56 [ayvens.es] INFO: Found listing with ID: 1878752
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878752%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [ayvens.es] INFO: Scrape type for 1878752: 1
2026-01-28 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1878752
2026-01-28 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ad6691-7493-5cac-9675-0920f4d42607 with identifier: 1878752
2026-01-28 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ad6691-7493-5cac-9675-0920f4d42607 with scrape type 1
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f7ad6691-7493-5cac-9675-0920f4d42607
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F867%252F4fcdc590076b49208adb9344e3368fcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/867/4fcdc590076b49208adb9344e3368fcd/images/large/1.jpg not downloaded yet
2026-01-28 20:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 66418072-afcd-55b5-aa10-132e1cb26c5b with identifier: 1878741
2026-01-28 20:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 66418072-afcd-55b5-aa10-132e1cb26c5b with identifier: 1878741
2026-01-28 20:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 66418072-afcd-55b5-aa10-132e1cb26c5b spider: ayvens.es
2026-01-28 20:03:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 66418072-afcd-55b5-aa10-132e1cb26c5b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '66418072-afcd-55b5-aa10-132e1cb26c5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 67028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66418072-afcd-55b5-aa10-132e1cb26c5b/66418072-afcd-55b5-aa10-132e1cb26c5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/225/dbc056232376483faeebd14b0513942b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 73kW CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 73kW CONTROL',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878741%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [ayvens.es] INFO: Saving data for 1878741: {'created_time': 1769630636.817447, 'last_price_update_time': 1769630636.817459, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878741') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2a086c4-f02f-5ada-a456-dd463fa91178 with identifier: 1878743
2026-01-28 20:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2a086c4-f02f-5ada-a456-dd463fa91178 with identifier: 1878743
2026-01-28 20:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2a086c4-f02f-5ada-a456-dd463fa91178 with identifier: 1878743 to the API
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/677/9416c84b6762420d8105e0281d98872c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f2a086c4-f02f-5ada-a456-dd463fa91178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AYGO',
 'odometer': 137626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2a086c4-f02f-5ada-a456-dd463fa91178/f2a086c4-f02f-5ada-a456-dd463fa91178_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/677/9416c84b6762420d8105e0281d98872c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA AYGO 1.0 70 x-play',
 'transmission': 'manual',
 'trim': '1.0 70 x-play',
 'vin': None,
 'year': 2018}
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878743%27 HTTP/1.1" 200 None
2026-01-28 20:03:57 [ayvens.es] INFO: Saving data for 1878743: {'created_time': 1769630637.265118, 'last_price_update_time': 1769630637.26513, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878743') HTTP/1.1" 204 0
2026-01-28 20:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f103b59-3597-5285-93c2-a2e70f591412 with identifier: 1878742
2026-01-28 20:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f103b59-3597-5285-93c2-a2e70f591412 with identifier: 1878742
2026-01-28 20:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 20:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5f103b59-3597-5285-93c2-a2e70f591412 spider: ayvens.es
2026-01-28 20:03:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 5f103b59-3597-5285-93c2-a2e70f591412 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f103b59-3597-5285-93c2-a2e70f591412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 144639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f103b59-3597-5285-93c2-a2e70f591412/5f103b59-3597-5285-93c2-a2e70f591412_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/671/bea5320a6eca465a82c159ff8c51fb72/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Combi 1.6 BlueHDi 73KW (100CV) Compact',
 'transmission': 'manual',
 'trim': 'Combi 1.6 BlueHDi 73KW (100CV) Compact',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878742%27 HTTP/1.1" 200 None
2026-01-28 20:03:57 [ayvens.es] INFO: Saving data for 1878742: {'created_time': 1769630637.500998, 'last_price_update_time': 1769630637.501007, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878742') HTTP/1.1" 204 0
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca1f9dd0>
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ab6f05-f777-5746-93ad-0c25b401b2c9/e0ab6f05-f777-5746-93ad-0c25b401b2c9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F399%252F0ab8248f76174e18b5bff7b77315e614%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/399/0ab8248f76174e18b5bff7b77315e614/images/large/1.jpg saved to cache
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0ab6f05-f777-5746-93ad-0c25b401b2c9
2026-01-28 20:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0ab6f05-f777-5746-93ad-0c25b401b2c9, skipping ID generation
2026-01-28 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ab6f05-f777-5746-93ad-0c25b401b2c9 with scrape type 1
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e0ab6f05-f777-5746-93ad-0c25b401b2c9 from tracking dictionaries
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0ab6f05-f777-5746-93ad-0c25b401b2c9 sending to next pipeline
2026-01-28 20:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0ab6f05-f777-5746-93ad-0c25b401b2c9, identifier: 1878744
2026-01-28 20:03:57 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-01-28 20:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0ab6f05-f777-5746-93ad-0c25b401b2c9 with identifier: 1878744
2026-01-28 20:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0ab6f05-f777-5746-93ad-0c25b401b2c9 with identifier: 1878744
2026-01-28 20:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160058 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160058
2026-01-28 20:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e0ab6f05-f777-5746-93ad-0c25b401b2c9 spider: ayvens.es
2026-01-28 20:03:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e0ab6f05-f777-5746-93ad-0c25b401b2c9 due to rule: high_mileage_for_country.json, error: 160058 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160058
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0ab6f05-f777-5746-93ad-0c25b401b2c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 160058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ab6f05-f777-5746-93ad-0c25b401b2c9/e0ab6f05-f777-5746-93ad-0c25b401b2c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/399/0ab8248f76174e18b5bff7b77315e614/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 110kW 4Drive DSG-6 St&Sp X-p+++Vehiculo '
          'procedente de flota policial+++',
 'transmission': 'manual',
 'trim': 'ST 2.0 TDI 110kW 4Drive DSG-6 St&Sp X-p+++Vehiculo procedente de '
         'flota policial+++',
 'vin': None,
 'year': 2018}
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878744%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [ayvens.es] INFO: Saving data for 1878744: {'created_time': 1769630638.220699, 'last_price_update_time': 1769630638.220709, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878744') HTTP/1.1" 204 0
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/771/9b19a9051c9848cf8b2e1fce2c916138/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/337/658d0a9eec5a45eea85ec97a2fd18c05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/773/04e2d6c8789e448ab03e7b82628ccebd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/049/85582fc50e0740479805e5751285d1a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/957/2f9e8260f5b349bfb54e55b32d1cc7ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/322/2445944fe60b4a1598e914edeb7dd2fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/010/c7b6351845604c2885efaa4c07a0c3e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9149a10>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb85210c-70e7-5627-808e-62fa21e57e2f/fb85210c-70e7-5627-808e-62fa21e57e2f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252F9b19a9051c9848cf8b2e1fce2c916138%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/9b19a9051c9848cf8b2e1fce2c916138/images/large/1.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb85210c-70e7-5627-808e-62fa21e57e2f
2026-01-28 20:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb85210c-70e7-5627-808e-62fa21e57e2f, skipping ID generation
2026-01-28 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb85210c-70e7-5627-808e-62fa21e57e2f with scrape type 1
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fb85210c-70e7-5627-808e-62fa21e57e2f from tracking dictionaries
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb85210c-70e7-5627-808e-62fa21e57e2f sending to next pipeline
2026-01-28 20:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fb85210c-70e7-5627-808e-62fa21e57e2f, identifier: 1878746
2026-01-28 20:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fb85210c-70e7-5627-808e-62fa21e57e2f with identifier: 1878746
2026-01-28 20:03:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fb85210c-70e7-5627-808e-62fa21e57e2f with identifier: 1878746
2026-01-28 20:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
2026-01-28 20:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fb85210c-70e7-5627-808e-62fa21e57e2f spider: ayvens.es
2026-01-28 20:03:59 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: fb85210c-70e7-5627-808e-62fa21e57e2f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fb85210c-70e7-5627-808e-62fa21e57e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 144285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb85210c-70e7-5627-808e-62fa21e57e2f/fb85210c-70e7-5627-808e-62fa21e57e2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/771/9b19a9051c9848cf8b2e1fce2c916138/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Furgon BM TN L3H2 2.0TDI 75kW (102CV)',
 'transmission': 'manual',
 'trim': '35 Furgon BM TN L3H2 2.0TDI 75kW (102CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878746%27 HTTP/1.1" 200 None
2026-01-28 20:03:59 [ayvens.es] INFO: Saving data for 1878746: {'created_time': 1769630639.099124, 'last_price_update_time': 1769630639.099138, 'auction_closing_time': 1769688000.0}
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878746') HTTP/1.1" 204 0
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c9172810>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4dea948-7dc4-5e49-970e-1698c77b5665/d4dea948-7dc4-5e49-970e-1698c77b5665_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F337%252F658d0a9eec5a45eea85ec97a2fd18c05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/337/658d0a9eec5a45eea85ec97a2fd18c05/images/large/1.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4dea948-7dc4-5e49-970e-1698c77b5665
2026-01-28 20:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4dea948-7dc4-5e49-970e-1698c77b5665, skipping ID generation
2026-01-28 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4dea948-7dc4-5e49-970e-1698c77b5665 with scrape type 1
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d4dea948-7dc4-5e49-970e-1698c77b5665 from tracking dictionaries
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4dea948-7dc4-5e49-970e-1698c77b5665 sending to next pipeline
2026-01-28 20:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d4dea948-7dc4-5e49-970e-1698c77b5665, identifier: 1878745
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca21fb50>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d94a5012-eb83-5481-a9df-9358eaef5082/d94a5012-eb83-5481-a9df-9358eaef5082_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F773%252F04e2d6c8789e448ab03e7b82628ccebd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/773/04e2d6c8789e448ab03e7b82628ccebd/images/large/1.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d94a5012-eb83-5481-a9df-9358eaef5082
2026-01-28 20:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d94a5012-eb83-5481-a9df-9358eaef5082, skipping ID generation
2026-01-28 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d94a5012-eb83-5481-a9df-9358eaef5082 with scrape type 1
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d94a5012-eb83-5481-a9df-9358eaef5082 from tracking dictionaries
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d94a5012-eb83-5481-a9df-9358eaef5082 sending to next pipeline
2026-01-28 20:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d94a5012-eb83-5481-a9df-9358eaef5082, identifier: 1878747
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81c91706d0>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_460ab97b-50a0-5549-a822-cd4473c6dbe3/460ab97b-50a0-5549-a822-cd4473c6dbe3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F85582fc50e0740479805e5751285d1a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/85582fc50e0740479805e5751285d1a9/images/large/1.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 460ab97b-50a0-5549-a822-cd4473c6dbe3
2026-01-28 20:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 460ab97b-50a0-5549-a822-cd4473c6dbe3, skipping ID generation
2026-01-28 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460ab97b-50a0-5549-a822-cd4473c6dbe3 with scrape type 1
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 460ab97b-50a0-5549-a822-cd4473c6dbe3 from tracking dictionaries
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 460ab97b-50a0-5549-a822-cd4473c6dbe3 sending to next pipeline
2026-01-28 20:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 460ab97b-50a0-5549-a822-cd4473c6dbe3, identifier: 1878749
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca21c5d0>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d1eefd7-7444-5252-9211-b75e1c582f73/9d1eefd7-7444-5252-9211-b75e1c582f73_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252F2f9e8260f5b349bfb54e55b32d1cc7ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/2f9e8260f5b349bfb54e55b32d1cc7ed/images/large/1.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d1eefd7-7444-5252-9211-b75e1c582f73
2026-01-28 20:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d1eefd7-7444-5252-9211-b75e1c582f73, skipping ID generation
2026-01-28 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1eefd7-7444-5252-9211-b75e1c582f73 with scrape type 1
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9d1eefd7-7444-5252-9211-b75e1c582f73 from tracking dictionaries
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d1eefd7-7444-5252-9211-b75e1c582f73 sending to next pipeline
2026-01-28 20:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d1eefd7-7444-5252-9211-b75e1c582f73, identifier: 1878748
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca286b10>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23ffb28d-224c-5a9e-942a-2554d6eb2573/23ffb28d-224c-5a9e-942a-2554d6eb2573_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F322%252F2445944fe60b4a1598e914edeb7dd2fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/322/2445944fe60b4a1598e914edeb7dd2fd/images/large/1.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23ffb28d-224c-5a9e-942a-2554d6eb2573
2026-01-28 20:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23ffb28d-224c-5a9e-942a-2554d6eb2573, skipping ID generation
2026-01-28 20:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ffb28d-224c-5a9e-942a-2554d6eb2573 with scrape type 1
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 23ffb28d-224c-5a9e-942a-2554d6eb2573 from tracking dictionaries
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23ffb28d-224c-5a9e-942a-2554d6eb2573 sending to next pipeline
2026-01-28 20:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23ffb28d-224c-5a9e-942a-2554d6eb2573, identifier: 1878750
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca895490>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b754f1ee-5064-558e-a672-9590641b0439/b754f1ee-5064-558e-a672-9590641b0439_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F010%252Fc7b6351845604c2885efaa4c07a0c3e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/010/c7b6351845604c2885efaa4c07a0c3e9/images/large/1.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b754f1ee-5064-558e-a672-9590641b0439
2026-01-28 20:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b754f1ee-5064-558e-a672-9590641b0439, skipping ID generation
2026-01-28 20:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b754f1ee-5064-558e-a672-9590641b0439 with scrape type 1
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b754f1ee-5064-558e-a672-9590641b0439 from tracking dictionaries
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b754f1ee-5064-558e-a672-9590641b0439 sending to next pipeline
2026-01-28 20:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b754f1ee-5064-558e-a672-9590641b0439, identifier: 1878751
2026-01-28 20:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d4dea948-7dc4-5e49-970e-1698c77b5665 with identifier: 1878745
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d4dea948-7dc4-5e49-970e-1698c77b5665 with identifier: 1878745
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d4dea948-7dc4-5e49-970e-1698c77b5665 spider: ayvens.es
2026-01-28 20:04:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d4dea948-7dc4-5e49-970e-1698c77b5665 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd4dea948-7dc4-5e49-970e-1698c77b5665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 90163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4dea948-7dc4-5e49-970e-1698c77b5665/d4dea948-7dc4-5e49-970e-1698c77b5665_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/337/658d0a9eec5a45eea85ec97a2fd18c05/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878745%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [ayvens.es] INFO: Saving data for 1878745: {'created_time': 1769630641.833444, 'last_price_update_time': 1769630641.833455, 'auction_closing_time': 1769688000.0}
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878745') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d94a5012-eb83-5481-a9df-9358eaef5082 with identifier: 1878747
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d94a5012-eb83-5481-a9df-9358eaef5082 with identifier: 1878747
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d94a5012-eb83-5481-a9df-9358eaef5082 spider: ayvens.es
2026-01-28 20:04:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d94a5012-eb83-5481-a9df-9358eaef5082 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd94a5012-eb83-5481-a9df-9358eaef5082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 154294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d94a5012-eb83-5481-a9df-9358eaef5082/d94a5012-eb83-5481-a9df-9358eaef5082_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/773/04e2d6c8789e448ab03e7b82628ccebd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Furgon BM TN L3H2 2.0TDI 75kW (102CV)',
 'transmission': 'manual',
 'trim': '35 Furgon BM TN L3H2 2.0TDI 75kW (102CV)',
 'vin': None,
 'year': 2019}
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878747%27 HTTP/1.1" 200 None
2026-01-28 20:04:02 [ayvens.es] INFO: Saving data for 1878747: {'created_time': 1769630642.073053, 'last_price_update_time': 1769630642.073064, 'auction_closing_time': 1769688000.0}
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878747') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 460ab97b-50a0-5549-a822-cd4473c6dbe3 with identifier: 1878749
2026-01-28 20:04:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 460ab97b-50a0-5549-a822-cd4473c6dbe3 with identifier: 1878749
2026-01-28 20:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 460ab97b-50a0-5549-a822-cd4473c6dbe3 with identifier: 1878749 to the API
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/049/85582fc50e0740479805e5751285d1a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '460ab97b-50a0-5549-a822-cd4473c6dbe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 84859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_460ab97b-50a0-5549-a822-cd4473c6dbe3/460ab97b-50a0-5549-a822-cd4473c6dbe3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/049/85582fc50e0740479805e5751285d1a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 140CV GPF Micro Hibrido',
 'transmission': 'manual',
 'trim': 'Intens TCe 140CV GPF Micro Hibrido',
 'vin': None,
 'year': 2021}
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878749%27 HTTP/1.1" 200 None
2026-01-28 20:04:02 [ayvens.es] INFO: Saving data for 1878749: {'created_time': 1769630642.537065, 'last_price_update_time': 1769630642.537075, 'auction_closing_time': 1769688000.0}
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878749') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d1eefd7-7444-5252-9211-b75e1c582f73 with identifier: 1878748
2026-01-28 20:04:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d1eefd7-7444-5252-9211-b75e1c582f73 with identifier: 1878748
2026-01-28 20:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d1eefd7-7444-5252-9211-b75e1c582f73 with identifier: 1878748 to the API
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/957/2f9e8260f5b349bfb54e55b32d1cc7ed/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris grafito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9d1eefd7-7444-5252-9211-b75e1c582f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 111990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d1eefd7-7444-5252-9211-b75e1c582f73/9d1eefd7-7444-5252-9211-b75e1c582f73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/957/2f9e8260f5b349bfb54e55b32d1cc7ed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878748%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [ayvens.es] INFO: Saving data for 1878748: {'created_time': 1769630643.072915, 'last_price_update_time': 1769630643.072927, 'auction_closing_time': 1769688000.0}
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878748') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23ffb28d-224c-5a9e-942a-2554d6eb2573 with identifier: 1878750
2026-01-28 20:04:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23ffb28d-224c-5a9e-942a-2554d6eb2573 with identifier: 1878750
2026-01-28 20:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 23ffb28d-224c-5a9e-942a-2554d6eb2573 with identifier: 1878750 to the API
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/322/2445944fe60b4a1598e914edeb7dd2fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Rojo deseo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '23ffb28d-224c-5a9e-942a-2554d6eb2573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 64862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23ffb28d-224c-5a9e-942a-2554d6eb2573/23ffb28d-224c-5a9e-942a-2554d6eb2573_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/322/2445944fe60b4a1598e914edeb7dd2fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (E) Intens Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': '(E) Intens Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2021}
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878750%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [ayvens.es] INFO: Saving data for 1878750: {'created_time': 1769630643.50927, 'last_price_update_time': 1769630643.509282, 'auction_closing_time': 1769688000.0}
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878750') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b754f1ee-5064-558e-a672-9590641b0439 with identifier: 1878751
2026-01-28 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b754f1ee-5064-558e-a672-9590641b0439 with identifier: 1878751
2026-01-28 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
2026-01-28 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b754f1ee-5064-558e-a672-9590641b0439 spider: ayvens.es
2026-01-28 20:04:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b754f1ee-5064-558e-a672-9590641b0439 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b754f1ee-5064-558e-a672-9590641b0439',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 161672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b754f1ee-5064-558e-a672-9590641b0439/b754f1ee-5064-558e-a672-9590641b0439_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/010/c7b6351845604c2885efaa4c07a0c3e9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2020}
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878751%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [ayvens.es] INFO: Saving data for 1878751: {'created_time': 1769630643.800327, 'last_price_update_time': 1769630643.800365, 'auction_closing_time': 1769688000.0}
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878751') HTTP/1.1" 204 0
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/867/4fcdc590076b49208adb9344e3368fcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f81ca21ae90>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7ad6691-7493-5cac-9675-0920f4d42607/f7ad6691-7493-5cac-9675-0920f4d42607_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F867%252F4fcdc590076b49208adb9344e3368fcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/867/4fcdc590076b49208adb9344e3368fcd/images/large/1.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7ad6691-7493-5cac-9675-0920f4d42607
2026-01-28 20:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7ad6691-7493-5cac-9675-0920f4d42607, skipping ID generation
2026-01-28 20:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ad6691-7493-5cac-9675-0920f4d42607 with scrape type 1
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f7ad6691-7493-5cac-9675-0920f4d42607 from tracking dictionaries
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7ad6691-7493-5cac-9675-0920f4d42607 sending to next pipeline
2026-01-28 20:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f7ad6691-7493-5cac-9675-0920f4d42607, identifier: 1878752
2026-01-28 20:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f7ad6691-7493-5cac-9675-0920f4d42607 with identifier: 1878752
2026-01-28 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f7ad6691-7493-5cac-9675-0920f4d42607 with identifier: 1878752
2026-01-28 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184918 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184918
2026-01-28 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f7ad6691-7493-5cac-9675-0920f4d42607 spider: ayvens.es
2026-01-28 20:04:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: f7ad6691-7493-5cac-9675-0920f4d42607 due to rule: high_mileage_for_country.json, error: 184918 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184918
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f7ad6691-7493-5cac-9675-0920f4d42607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39172',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 184918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7ad6691-7493-5cac-9675-0920f4d42607/f7ad6691-7493-5cac-9675-0920f4d42607_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/867/4fcdc590076b49208adb9344e3368fcd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 110kW 4Drive DSG-6 St&Sp X-p+++Vehiculo '
          'procedente de flota policial+++',
 'transmission': 'manual',
 'trim': 'ST 2.0 TDI 110kW 4Drive DSG-6 St&Sp X-p+++Vehiculo procedente de '
         'flota policial+++',
 'vin': None,
 'year': 2018}
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271878752%27 HTTP/1.1" 200 None
2026-01-28 20:04:04 [ayvens.es] INFO: Saving data for 1878752: {'created_time': 1769630644.531691, 'last_price_update_time': 1769630644.531706, 'auction_closing_time': 1769688000.0}
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1878752') HTTP/1.1" 204 0
2026-01-28 20:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:04:05 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 20:04:05 [ayvens.es] INFO: ayvens.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 10, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20last_price_update_time%20lt%201769198645 HTTP/1.1" 200 None
2026-01-28 20:04:05 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (120 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.es/task_54_2026-01-28T20_00_00.jl
2026-01-28 20:04:05 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 110586,
 'downloader/request_count': 230,
 'downloader/request_method_count/GET': 226,
 'downloader/request_method_count/POST': 4,
 'downloader/response_bytes': 96820211,
 'downloader/response_count': 230,
 'downloader/response_status_count/200': 230,
 'elapsed_time_seconds': 232.763289,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 28, 20, 4, 5, 335309, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 105,
 'item_dropped_reasons_count/DropItem': 105,
 'item_scraped_count': 120,
 'log_count/DEBUG': 4523,
 'log_count/INFO': 5489,
 'memusage/max': 181825536,
 'memusage/startup': 127115264,
 'photo_download_count': 225,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 137,
 'playwright/request_count/aborted': 17,
 'playwright/request_count/method/GET': 133,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 32,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 119,
 'playwright/response_count/method/GET': 116,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 15,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 4,
 'response_received_count': 5,
 'scheduler/dequeued': 230,
 'scheduler/dequeued/memory': 230,
 'scheduler/enqueued': 230,
 'scheduler/enqueued/memory': 230,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 4,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.699829581892118,
 'scrapy-zyte-api/mean_response_seconds': 5.71166225313209,
 'scrapy-zyte-api/processed': 4,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 4,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 4,
 'scrapy-zyte-api/request_args/httpRequestBody': 4,
 'scrapy-zyte-api/request_args/httpRequestMethod': 4,
 'scrapy-zyte-api/request_args/httpResponseBody': 4,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 4,
 'scrapy-zyte-api/request_args/url': 4,
 'scrapy-zyte-api/status_codes/200': 4,
 'scrapy-zyte-api/success': 4,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 28, 20, 0, 12, 572020, tzinfo=datetime.timezone.utc)}
2026-01-28 20:04:05 [scrapy.core.engine] INFO: Spider closed (finished)